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Abstract. The infinite symmetric group S(oo), whose elements are finite permuta- 
tions of {1, 2, 3, . . . }, is a model example of a "big" group. By virtue of an old result 
of Murray— von Neumann, the one-sided regular representation of 5(00) in the Hilbcrt 
space £ 2 (S(oo)) generates a type Hi von Neumann factor while the two— sided regular 
representation is irreducible. This shows that the conventional scheme of harmonic 
analysis is not applicable to S(oo): for the former representation, decomposition into 
irreducibles is highly non-unique, and for the latter representation, there is no need of 
any decomposition at all. We start with constructing a compactification & D S(oo), 
which we call the space of virtual permutations. Although & is no longer a group, 
it still admits a natural two— sided action of S(oo). Thus, © is a G— space, where 
G stands for the product of two copies of S(oo). On S, there exists a unique G- 
invariant probability measure fii, which has to be viewed as a "true" Haar measure 
for 5(oo). More generally, we include fii into a family {fit : t > 0} of distinguished 
G-quasiinvariant probability measures on virtual permutations. By making use of 
these measures, we construct a family {T z : 2 £ C} of unitary representations of G, 
called generalized regular representations (each representation T 2 with 2 ^ can be 
realized in the Hilbert space L 2 (&, fit), where t = \z\ 2 ). As \z\ — > 00, the generalized 
regular representations T z approach, in a suitable sense, the "naive" two-sided regu- 
lar representation of the group G in the space £ 2 (S(oo)). In contrast with the latter 
representation, the generalized regular representations T z are highly reducible and 
have a rich structure. We prove that any T z admits a (unique) decomposition into 
a multiplicity free continuous integral of irreducible representations of G. For any 
two distinct (and not conjugate) complex numbers zi, 22, the spectral types of the 
representations T Z1 and T Z2 are shown to be disjoint. In the case 2 £ Z, a complete 
description of the spectral type is obtained. Further work on the case 2 £ C \ Z 
reveals a remarkable link with stochastic point processes and random matrix theory. 
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0. Introduction 

0.1. The infinite symmetric group: characters, factor representations, 
spherical representations. The present paper deals with harmonic analysis on 
the infinite symmetric group S(oo) (the group of finite permutations of the infinite 
set {1,2,...}). This group belongs to the class of big groups, 1 such as the infinite 
dimensional classical groups, diffeomorphism and current groups. We present here 
the first example of harmonic analysis on a big group. A short exposition of our 
results was published in [KOV]; here we provide the detailed statements and proofs. 

The most well-studied groups in representation theory — compact, abelian, 
and reductive Lie groups — are tame. Irreducible unitary representations of tame 
groups can be classified, and the basic problem of harmonic analysis consists in 
decomposing interesting reducible representations (e.g., the regular representation) 
into irreducible components. 

The group £(00) is wild, not tame. The wild groups do not admit any sensible 
classification of irreducible representations, and reducible representations can be 
decomposed into irreducibles in essentially different ways. Unlike tame groups, the 
wild groups have factor representations of von Neumann types II and III. All those 
facts imply that the representation theory of wild groups should be based on the 
principles distinct from those used for tame groups. 2 

The possibility of developing such a theory was first demonstrated by E. Thoma 
[Thol] exactly for the example of 5(oo). In that paper Thoma discovered that the 
finite type factor representations of the group S (00) admit an explicit classifica- 
tion. More precisely, those representations are labelled by the pairs ui = (a; (3) of 
nonincreasing sequences of nonnegative numbers 

a = (ai > a 2 > • • • > 0), 0=(pi>fo> 
subject to the extra condition 

00 00 
^a fe + ^/3 fe < 1. 
fc=i fc=i 

1 This term, introduced in Vershik [Vcr], is somewhat vague but expressive and convenient. 
About representations of various big groups, see, e.g., Ismagilov [Ism], Neretin [Nerl], Olshanski 
[014], Stratila-Voiculcscu [SV]. 

2 For general facts about tame and wild groups, see, e.g., Dixmier [Dix], Kirillov [Kir], Note 
that tame groups are also called type / groups. About factor representations, sec, e.g., Dixmier 
[Dix], Thoma [Tho2]. 
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The set of such pairs forms an infinite dimensional simplex which we call the 
Thoma simplex? 

For an arbitrary unitary representation of a countable group, generating a von 
Neumann algebra of finite type, a decomposition into a direct integral of factor 
representations always exists and is essentially unique. Therefore, the main problem 
of harmonic analysis on S{oo) may consist in the actual decomposition of most 
notable representations of finite type. This agrees with an old idea (especially 
developed by Pukanszky) that as "elementary representations" for a wild group, 
one should consider not irreducible representations but factor representations of an 
appropriate class. 

Instead of decompositions of representations one can speak of decompositions of 
their characters. Denote by X the set of positive definite functions \ on the group 
S'(oo), constant on conjugacy classes and normalized at the identity permutation 
by the condition x( e ) = 1- In the topology of pointwise convergence, the space 
X is a convex compact set. It is known that the extreme points of the set X are 
exactly the characters of factor representations of finite type. Moreover, the space 
A" is a Choquet simplex, that is, any point \ G X can be uniquely represented as a 
continual convex combination of extreme characters. 

However, as was shown by one of the authors ([012], [013]), one can develop 
another approach to representation theory of the group S'(oo), which makes it 
possible to avoid factor representations. Recall that, by definition, the group S(oo) 
consists of finite permutations of the set {1,2, . . .}, fixing all but finitely many 
points. Consider now the group S(oo) of all bijections of the set {1,2, . . .} onto 
itself. Taking the subsets 

S m {oo) = {g e S(oo) : g(k) = k, k = 1, . . . , m}, 

where m = 1,2,..., as a fundamental system of neighborhoods of identity we turn 
S'(oo) into a topological group. 

The subgroup 5(00) is dense in 5(00). Furthermore, denote by G the group of 
pairs (31,32) € S(oo) x S(oo), such that gf 1 ^ € S(oo), and identify S(oo) with 
the diagonal subgroup K in G. We introduce a topology in G by proclaiming the 
subgroup K open. The group S(oo) x S(oo) is dense in G. The groups K and G 
are totally disconnected and not locally compact. 

Remarkably enough, the topological group G is tame and its irreducible represen- 
tations can be completely described, see Olshanski [013], Okounkov [Okl], [Ok2]. 
In the present paper we are only interested in spherical irreducible representations 
of the group G (that is, representations containing a ^-invariant vector). It is 
known that (G, K) is a Gelfand pair: in any irreducible spherical representation 
there is only one, up to a scalar factor, if -invariant vector £. 

There exists a natural bijection T <-> ir between irreducible spherical representa- 
tions T of the pair (G, K) and factor representations tt of finite type of the group 
5(oo). Specifically, 7r is the restriction of T to the subgroup S(oo) x {e} C G. The 
character %(s) = Tr ir(s) of the representation it (here "Tr" denotes the normalized 
trace on the factor) is related to the spherical function ip(g) = {T(g)£,{;) by the 
simple formula 

^(91,92) = x(9i 1 92), (51,52) eG. 



3 For more detail on Thoma's theorem, see §9.6 below. 
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Therefore, we can think of finite factor representations of the group S(oo) as of 
irreducible spherical representations of the pair (G, K), thus returning to the con- 
ventional setup of representation theory of tame groups. 

0.2. The generalized regular representations T z and the problem of har- 
monic analysis. We shall now describe the representations of the group G whose 
decomposition is the purpose of the present paper. The choice of those represen- 
tations is itself a nontrivial problem. Traditionally, the object of harmonic anal- 
ysis for a Gelfand pair (<?,/C) is the decomposition of the natural representation 
of Q in the space L 2 {Q/JC) (for instance, for Ricmannian symmetric spaces Q/JC, 
the decomposition problem was studied in classical works of Harish-Chandra and 
Gindikin-Karpelevich). In our situation the space G/K = S(oo) is discrete, so that 
the Hilbert space L 2 (G/K) = £ 2 (S(oo)) makes sense. However, the corresponding 
representation turns out to be irreducible so that there is no need of any further 
decomposition. This irreducibility effect is equivalent to the following fact (which 
is probably better known): the one-sided regular representation of the group S(oo) 
in the space £ 2 (S(oo)) generates a type Hi factor. 4 

Instead of the homogeneous space G/K = S(oo) we introduce a compact space 
& containing 5(00) as a dense subset. More precisely, the space & is defined as a 
projective limit of finite sets, 

<- S(2) <-...<- S(n) <-.. . . 

Here S(n) is the set of all permutations of n objects, and the projections are specified 
in §1 below. The points of & are called virtual permutations. Unlike S (00), the 
space & is not a group. However, it admits a canonical action of the group G, 
which is sufficient for our purposes. In particular, we have a two-sided action of 
the group S'(oo) on 6. 

On the space 6 D S(oo) of virtual permutations there is a (unique) probability 
measure invariant with respect to the action of the group G. This measure, which we 
denote as fii, is much more interesting and useful than the counting (Haar) measure 
on S(oo). More generally, the measure m can be included into a one-parameter 
family of probability measures fit, t > 0. All those measures are invariant with 
respect to the subgroup K, and quasiinvariant with respect to G. 

By applying a standard general construction of producing unitary representa- 
tions from a group action with quasiinvariant measure, we arrive at a family of 
representations T z of the group G. Here z ranges over the set C \ {0}, and the 
representation T z acts in the space L 2 (&,fi t ) where t — \z\ 2 . One can also define 
two more unitary representations T , in such a way that the resulting family 
is continuously parametrized by the points of the Ricmann sphere C U {00}. The 
representation coincides with the above mentioned two-sided regular represen- 
tation in the space £ 2 (S(oo)). We regard the family {T z } as a deformation of T<x>, 



4 More generally, for any discrete group whose conjugacy classes, except {e}, are infinite, the 
one— sided regular representation is a type Hi factor representation, while the two— sided regular 
representation is irreducible. See Murray-von Neumann [MvN, chapter 5], Naimark [Nai, chapter 
VII, §38.5]. 

5 The idea of extending the group space (of a big group) in order to obtain measures with good 
transformation properties comes from the measure theory on infinite-dimensional linear spaces 
and is rather old, see, e.g., Gelfand-Vilenkin [GV, chapter IV]. 
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and we call T z the generalized regular representations.® 

The only irreducible representation in the family {T z : z e C U {oo}} is T^. 
All the representations T z , z e C, are reducible, and their structure is rather 
complicated. We consider the explicit decomposition of those representations as 
the main problem of harmonic analysis for the group S(oo). 

Each representation T z can also be realized as an inductive limit of the two-sided 
regular representations of finite groups S(n) x S(n), 

Reg 1 - Reg 2 ->...- Reg" ->..., (*) 

with very special embeddings Reg™ — > Reg™ +1 depending on z. The existence of a 
finite dimensional approximation allows one to employ the powerful combinatorial 
and probabilistic techniques used in the theory of approximately finite- dimensional 
(AF-) algebras. In case of the group 5(oo), these techniques, based on combina- 
torics of Young diagrams and the theory of symmetric functions, were developed in 
[VK2], [VK3] . 

0.3. Main results of the paper. These are as follows: 

1. The representations T z and T z are equivalent, and we describe an intertwining 
operator realizing their equivalence. 

2. For any z e C, the representation T z can be decomposed into a multiplicity 
free direct integral of irreducible spherical representations. So, the equivalence class 
of T z is completely described by an equivalence class of measures on the Thoma 
simplex fi. We will refer to the latter equivalence class as to the spectral type of T z . 

3. The spectral types of two representations T Zl and T Z2 are disjoint (mutually 
singular) whenever z\ and z-i are not equal or conjugate to each other. This means 
that there exist two disjoint Borel subsets in ft supporting the measures from the 
spectral types of T Zl and T Z2 , respectively. Equivalently, there is no intertwining 
operator between T Zl and T Z2 . 

4. The spectral type of T z substantially depends on whether z is an integer 
or not. In the present paper we focus on the case when z G Z. Then we are 
able to describe the spectral type quite explicitly. Namely, let Q(p, q) denote the 
subset of those pairs (a, (3) € fl for which eti + ■ ■ ■ + a p + (3\ + ■ ■ ■ + (3 q = 1 
(consequently, all the remaining coordinates a, and pj vanish); notice that Q(p,q) 
is a (p+q— 1) -dimensional face of the Thoma simplex f2. Our result says that when 
z = 0, ±1, ±2, . . . , the spectral type of T z is determined by the union of Lebesgue 
measures on the finite-dimensional faces Q(p, q) with p — q = z (which agrees with 
the result on disjointness of spectral types stated above). We also show that if 
z E C \ Z, then the spectral type of T z is concentrated "inside" the simplex fi. 
That is, all faces Q(p, q) are null sets with respect to the spectral type of T z . 

0.4. The case z e C \ Z. This case is studied in detail in a series of papers by 
Borodin and Olshanski, see [015], [Bor2], [B03], the expository papers [BOl], [016], 
and references therein. When z € C \ Z, there exists a distinguished probability 
measure in the spectral type of T z (in the present paper it is denoted as o~ z ). The 
key idea is to assign to (SI, a z ) a stochastic point process, and to study its correlation 
functions. It turns out that the point processes thus obtained are close to those 



6 Notice a certain similarity between our family {T z } and Neretin's deformation of the natural 
representation on L 2 (Q/K.), where Q/K. is a Riemannian symmetric space, see Neretin [Ner3]. 
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arising in random matrix theory. The link with random matrix theory seems to be 
especially interesting and promising. 

The results of Borodin and Olshanski were obtained as a continuation of the 
project started in [KOV]. Together with the present work they provide a description 
of the spectral types for all representations T z . 

0.5. Organization of the paper. 

In §1, we start with the definition of the canonical projection p n : S(n) — > 
S(n — 1). Using the projections p n we define the space 6 = JimS(n) of virtual 
permutations. Then we describe four different concrete realizations of that space. 
In one of them, 6 turns into the product of an infinite sequence of finite sets. 
Finally, we show that 6 is a G-space, where G — S(oo) x S(oo), and we introduce 
an additive Z-valued 1-cocycle for the action of G on G. 

In §2, we study the family {fit}t>o of probability measures on the space &. This 
is a deformation of the unique G-invariant probability measure (in our notation, 
fii). The measures fit are central, i.e., invariant with respect to the action of the 
diagonal subgroup K C G. We show that they turn into product measures in one 
of the realizations of 6. Moreover, they are essentially the only central measures 
with this property. Applying Kakutani's theorem we show that the measures fi t 
are pairwise disjoint. Then we show that any fit is quasiinvariant with respect to 
the action of the group G, i.e., for any g £ G, the shift fif of fit by g is a measure 
in the equivalence class of fit- We also calculate the Radon-Nikodym derivative 
fif /fi t , which we will need later. 

In §3, we construct the representations T z in two different ways. First, we realize 
T z , where z € C*, in the Hilbert space L 2 (&,fi t ), where t — \z\ 2 . Here we use a 
multiplicative 1-cocycle 6 x G — > C* which depends on z and is defined via the 
additive cocycle from §2. Second, we realize the same representation T z as the 
inductive limit corresponding to a chain of embeddings (*), see above. Using the 
latter realization, it is easy to complete the family {T z } by two limit representations, 
T and T^. Finally, we present a transparent interpretation of the embeddings in 
(*)■ 

In §4, we define and study a distinguished matrix coefficient of T z . The repre- 
sentation T z has a distinguished iiT -invariant vector £o : in the first realization, this 
is the identity function fo = 1 on the space 6. Though the space of if-invariant 
vectors is infinite dimensional, £o is the only i-T-invariant vector which is seen at 
once: constructing other examples of -ftT-invariant vectors is already a nontrivial 
task (we do this in section 6). To the vector £o one associates a spherical function 
on G, ip z (g!,g 2 ) = (T{gi,g 2 )£o,£o), and a character Xz(s) = <p{s,e) of the group 
^(oo). We do not dispose of a simple expression for the values of the function \z 
on conjugacy classes of the group S(oo); instead of this, we find a very nice formula 
for the coefficients M Z (X) in the expansions 

Xz \ s{n) = ]T M z (X)x\ n=l,2,..., (**) 

where Y n denotes the set of Young diagrams with n boxes, and x A is the normalized 
irreducible character of S(n), indexed by A. In other words, we get the "Fourier 
coefficients" of \z (see Theorem 4.2.1). 

6 



This explicit formula for M Z (X) plays a key role in the present paper. 7 We derive 
from it the following results: 

First, we prove that £o is a cyclic vector if (and only if) z € C \ Z. This means 
that for nonintegral values of z, the spectral type of T z is entirely determined by 
the decomposition of the matrix coefficient associated with £ • 

Second, we prove the equivalence T z ~ T z , which is not evident from the con- 
struction of the representations. We also exhibit an isometric operator intertwining 
T z and T s . 

Finally, following the general philosophy of [VK2] , [VK3] , we assign to the family 
M z = {M z n ^} the so-called transition probabilities p z (X, v). Given A e Y„, the 
numbers p z (X, v) form a probability distribution on the set of those diagrams v that 
can be obtained from A by adding a single box. 

In §5, we deal with the realization of T z as an inductive limit of regular repre- 
sentations of the finite groups S(n) x S(n). To any such inductive limit we assign 
a "transition function" defined on the edges of the Young graph. This leads to 
a description of the commutant of the representation. We explicitly calculate the 
transition function for the representations T z . Using this, we get, for integral values 
of the parameter z, a decomposition of T z into a direct sum of subrepresentations 
T pq which we call the blocks of T z . 

In §6, we get a convenient realization of the subspace V z of if-invariant vectors 
in the Hilbert space of T z . In terms of this realization we construct, for any z e Z, a 
if-invariant vector in each block of T z , and we calculate the spectral decomposition 
of the corresponding matrix coefficient. 

In §7, we prove that all the vectors constructed in section 6 are cyclic vectors in 
the corresponding blocks. Together with the results of section 6 this provides us 
with a complete description of the spectral type of the representation T z in case of 
integral z. The argument of this section turns out to be rather long. At the end 
we give an example illustrating the origin of one of the difficulties. 

In §8, we deal with arbitrary values of the parameter z. Here we prove that the 
spectral types of the representations T z are pairwise disjoint (except the equivalence 
T z ~ Tz). 

In §9 (Appendix), we collected a number of necessary definitions and facts of 
general nature. 

0.6. Concluding remarks. The measures \i t involved in the construction of the 
representations T z are very interesting objects in their own right. Each measure fj,t 
can be written as a projective limit Hm/i™, as n ~ > oo, where /z™ is a remarkable 
probability measure on the finite symmetric group S(n). These measures /U™ were 
first discovered in the context of population genetics and were considered in many 
subsequent works (see, e.g., the encyclopedic article Tavare-Ewens [TE] and refer- 
ences therein). We will call the measures \i t the Ewens measures. The probability 
space (6, /i t ) is closely related to the Chinese Restaurant Process construction, see 
Aldous [Aid], Pitman [Pit, §3.1]. 

There is a similarity between the spectral decomposition of the characters \z 
attached to the representations T z , and the decomposition of the measures /i 4 into 
it-invariant ergodic components. In a certain sense, these two problems are dual 
to each other: the latter refers to the "group level" while the former refers to the 

7 For alternative derivations of the formula and generalizations, sec Kerov [Ker3], Borodin's 
appendix in Olshanski [015], Borodin-Olshanski [B02]. 
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"group dual level" . Moreover, there exists a general scheme unifying both problems 
and providing an interpolation between them, see Kerov [Ker3] , Kerov-Okounkov 
Olshanski [KOO], Borodin-Olshanski [B02]. The decomposition of the measures 
lit is governed by the Poisson-Dirichlet distributions, see Kingman [Kinl], [Kin2], 
and also Olshanski [015]. 

There is a deep analogy between the infinite symmetric group S{oo) and the 
infinite-dimensional unitary group U(oo). This analogy becomes apparent when 
one compares the description of characters of both groups, given in the fundamental 
papers Thoma [Thol] and Voiculescu [Voi]. The theory of harmonic analysis for 
S'(oo), as developed in the present paper and the papers of Borodin and Olshanski 
mentioned above, also has a counterpart for the group U(oo), sec Olshanski [016] 
and Borodin-Olshanski [B05]. 

In particular, the counterparts of the Ewens measures fit are the so-called Hua - 
Pickrell measures, see Borodin-Olshanski [B04]. More generally, similar measures 
can be associated to all 10 infinite series of classical Riemannian symmetric spaces 
of compact type, see Neretin [Ner2]. A pioneer work in this direction is that of 
Pickrell [Pic]; our construction of the space & of virtual permutations was largely 
influenced by that paper. 

As was first observed by Borodin, the expression (**) for the characters Xz can 
be analytically continued to provide a complementary series of characters. In the 
papers of Borodin and Olshanski, the characters of the complementary series are 
considered together with the characters \z , the latter being viewed as the principal 
series (for a justification of this terminology, see Okounkov [Ok3]; note that there 
also exists a degenerate series) . A natural question is whether these series of char- 
acters (and the corresponding representations) exhaust all "reasonable" objects of 
harmonic analysis for 5(oo). In this direction little is known. Using the idea of 
Borodin [Bor], Rozhkovskaya [Rozh] obtained an elegant combinatorial characteri- 
zation of the characters Xz and their analytic continuation. Kerov [Kerl] considered 
the so-called Ewens-Pitman measures generalizing the Ewens measures [it , as pos- 
sible candidates for an extension of the basic construction of the representations 
T z . It would be interesting to pursue further the study of this question. 



1.1. Canonical projections. Let S(n) be the group of permutations of the 
finite set {1, ... , n}, the symmetric group of degree n. We identify S(n) with 
the subgroup of permutations s e S(n + 1) preserving the last element n + 1, 
i.e., s(n +1) = n + 1. The inductive limit of groups S(n) with respect to these 
embeddings (i.e., the union of these groups) will be denoted as S(oo) = lira S(n). 
The elements of S(co) are finite permutations of the set {1, 2, . . . }, fixing all but 
finitely many natural numbers. We call S(oo) the infinite symmetric group. 

Given a permutation s € S(n + 1), n — 1, 2, . . . , we define its derivative permu- 
tation (we borrow the term from dynamical systems theory, see [CFS, chapter 1, 
§5]) s = s' e S(n) as follows 



where i = 1, . . . ,n. The map sh s, denoted p n , n +ii win be referred to as the 
canonical projection of S(n + 1) onto S(n). Here is an alternative description of the 



§1. The space of virtual permutations 




s~(i), if s(i) < n, 

s~(n + 1), if s(i) = n + 1 
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canonical projection in terms of the cycle structure of permutations. Depending on 
the position of the element n + 1 in the cycles of the permutation s we distinguish 
between two cases: n + 1 belongs to a cycle (. ..—*i—*n + l—*j—*...)of length 
> 2, or n + 1 is a fixed point of s. In the former case we remove n + 1 out of its 
cycle, i.e., we replace this cycle with (...—* i —> j — >...). In the latter case s 
already belongs to the subgroup S(n) C S(n +1), and we set s = s. 

It is clear from the definition that the preimage of a permutation s G S(n) with 
respect to the canonical projection contains n + 1 permutations in S(n + 1). In fact, 
in order to obtain a permutation s G Pnn+i( s ) one should insert n + 1 in a cycle 
of s right before one of the elements j = 1, . . . , n, or take n + 1 as a new 1-cycle. 
Note that in the latter case s = s. 

Yet another useful description of the canonical projection employs the following 
simple operation on graphs. It will be convenient to identify permutations with 
bipartite graphs. We associate with a permutation s G S(n) a graph with the 
vertex set {1, . . . ,n; 1', . . . ,n'}. Its edges are couples of the form where 
s(i) = j. The projection p n .n+i '■ s <— > s can now be described as follows. Take 
the graph of s, and add an extra edge connecting the vertices (n + 1) and (n + 1)'. 
Then the graph of the derivative permutation s arises if one takes for the edges the 
paths connecting the vertices in 1, ... , n with the vertices in 1', ... , n' . 

Note that the group S(n) acts by left and right multiplications on both S(n) 
and S(n + 1). 

Proposition 1.1.1. The canonical projection p n ,n+i is equivariant with respect to 
two-sided action of the group S(n). Ifn>A, this is the only map S(n + 1) — ► S(n) 
with this property. 

Proof. The first claim is immediate from the description of the canonical projection 
in terms of bipartite graphs, and the obvious graphical interpretation of the product 
of permutations. Assume now that the a map p : S(n + 1) — ► S(n) is equivariant. 
Then, for each permutation s G S(n), we have s~ 1 p(e)s = p{s~ l es) = p(e), where 
e is the identity permutation. Since e is the only central element in S(n) for n > 3, 
this implies p(e) = e. By the same token, s~ 1 p((n, n + l))s = p((n, n + 1)) for every 
permutation s G S(n — 1). If n > 4, then e is the only element of S(n) commuting 
with all permutations in S(n— 1) (for n = 2, 3 the transposition (12) also shares this 
property). Therefore, n > 4 implies p((n, n + 1)) = e. Since the group S(n + 1) is 
made of just two double S'(n)-cosets (the group S(n) itself and the class containing 
(n,n+ 1)), it follows that p — p n , n +i- □ 

Remark 1.1.2. As it is clear from the proof, there are non-canonical projections 
p : S(n + 1) — > S(n) for n = 2, 3. They are determined by the equalities p((23)) = 
(12) and p((34)) = (12) respectively. Note that there are lots of maps S(n + 1) — > 
S(n) which are equivariant with respect to a one-sided (left or right) action of the 
group S(n). 

1.2. Virtual permutations. Consider the sequence 

S(l) < <- S(n) <- 5(n + l) <- ... 

of canonical projections, and let 



6 = %mS(n) 
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denote the projective limit of the sets S(n). By definition, the elements of & 
are arbitrary sequences x = (x n € S(n)), such that p n .n+i(x n +i) = x n for all 
n = 1,2,.... The set 6 is a closed subset of the compact space of all sequences 
(x„), therefore it is a compact space itself. Let p n : & — > S(n) denote the natural 

projection, n = 1, 2, The group S'(co) can be identified with a subset of & via 

the map s i— ► x = (x n ), x n = s for sufficiently large n. In other words, 5(oo) C 6 
consists of the stable sequences (x n ). 

The subset 5(oo) is dense in 6, because p n (S (oo)) = p n {&) = S(n) for any n. 
Hence, the space 6 is a compactification of the discrete space S(oo). The elements 
of 6 will be called virtual permutations of the set {1,2, . . . }. 

The definition of the space 6 does not change if we remove from the projective 
limit any finite number of first terms, i.e., if we start from S(n) instead of 5(1), 
where n is chosen arbitrarily. This simple observation will be tacitly used in what 
follows. 

In particular, it implies that changing the canonical projections p n , n +i for n = 
2, 3 by noncanonical ones (see Remark 1.1.2) does not affect the construction of the 
space 6. 

1.3. Realizations of the space of virtual permutations. We shall use four 
concrete realizations of the space 6 of virtual permutations: 

(1) as of the infinite product n^Li{0> 1> ■ ■ ■ , n — 1}; 

(2) as of the space of growing trees; 

(3) as of the space of decreasing maps of the set {0, 1, ... } in itself; 

(4) as of the space of cyclic structures on the set {1,2,...}. 

All the constructions use appropriate realizations of finite sets S(n), and the 
canonical projections preserve the specific structures of those sets. In this sense, 
the above realizations are natural. 

Proposition 1.3.1. There exists a natural homeomorphism x = (x n ) i = (i n ) 
between the space & and the infinite product 

I = h x I 2 x . . . where I n = {0, 1, . . . , n - 1}. 

Proof. Given an element x — (x n ) G 6, we define the sequence i = (i n ) £ I 
as follows. Set i\ = 0. For every n = 1,2,... the coordinate i n +\ encodes the 
relation of s — x n and s — x n+ \. Specifically, i n+1 = means that s — s, and 
i n +i = j G {1, ... , n} means that the element n + 1 is inserted in a cycle of s 
immediately before j. One can easily check that this correspondence is indeed a 
homeomorphism & — ► 7, where I is equipped with the product topology. □ 

Likewise, we get a bijection S(n) — > I\ x • • -xl n . The vector i(x) = (ii,t2, ■ ■ ■ ,i n ) 
is called the code of a permutation x e S(n). We shall apply this terminology to 
virtual permutations, too. 

We define a finite increasing tree as a rooted labelled tree with n + 1 vertices, 
labelled by the numbers 0,1, ... , n in such a way that the root has label and 
the labels increase along every path leading off the root (cf. [Sta], §1.3). Countable 
increasing trees are defined in a similar way. 

Proposition 1.3.2. There exists a natural bijection between virtual permutations 
and countable increasing trees. 
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Proof. Let t be a countable increasing tree. Removing vertices with the labels 
n + 1, n + 2, . . . we obtain a finite increasing tree which we denote as r„. Thus, a 
tree r can be considered as the union of a chain n C r 2 C . . . of finite increasing 
trees, where Tj has z + 1 vertices. Given a tree r„, there are n + 1 options for the 
next tree r n+1 , which are naturally indexed by the numbers 0,1, ... ,n. In fact, 
we can join the vertex (n + 1) to every one of the vertices 0, ... ,n. Therefore, 
each countable increasing tree r is determined by the sequence i = (i n ) G I. One 
can easily check that that the map r (i n ) provides a bijection onto I. From 
Proposition 1.3.1 wc get a bijection between countable increasing trees, and virtual 
permutations. The above construction is quite similar to that of the bijection 
between permutations in S(n), and increasing trees with n + 1 vertices, cf. [Sta], 
§1.3. □ 

Note that the bijection 6 — > / identifies finite permutations s G S(oo) C 6 with 
the sequences i = (i n ) with only finitely many nonzero coordinates. There is also 
an obvious interpretation in terms of increasing trees. 

The first two realizations of virtual permutations are actually very close to each 
other. The third realization is a version of the first one, too. We say that a map 
ip of the set {0, 1, . . . } into itself is decreasing if <^(0) = and ip(n) < n for all 
n > 0. Setting ip(n) = i n for n > 1 we obtain a bijective correspondence between 
decreasing maps and the points of I. 

In the next subsection we describe the forth realization of virtual permutations; 
its nature is rather different from the first three. 

1.4. Cyclic structures. Let J be an arbitrary set. We define a cyclic order on J 
as a family of subsets [i,j), called arcs, and labelled by ordered pairs i,j of distinct 
points in J. We assume that the following four axioms hold: 

(1) for each pair i,j (where % ^ j) the arcs [j,i) do not intersect, and 
their union is J; 

(2) for each arc i G [i, j) (and hence j ^ 

(3) if k are pairwise distinct, then one of the arcs [i,k) is a strict 
subset of the other; 

(4) if the arc is a strict subset of [i, k), then [j, k) = [i, k) \ 

If | J| = 1, there is only one cyclic structure on J with the empty family of arcs. 

Note that cyclic orders on a finite set J arc in a bijective correspondence with 
cyclic permutations of the elements of J. In fact, given a cyclic permutation s of 
the set J, we define the corresponding cyclic order as follows: for each pair i ^ j the 
arc consists of the points i, s(i), . . . , s m_1 (i) where m is the least number with 
s m (i) = j. On the contrary, for infinite sets there is no natural relation between 
cyclic orders and permutations. 

More generally, we define a cyclic structure on a set J as a partition of J into 
nonempty disjoint subsets (called cycles) with a specified cyclic order on each cycle. 
Let CS(J) denote the set of all cyclic structures on J. If J is finite, there is a 
natural bijection between C'S(J) and the set of all permutations of J. Specifically, 
we associate with a permutation s its cycle partition with the cyclic order on each 
cycle as defined above. 

For every subset J' C J there is a natural projection CS(J) — ► CS(J'). More- 
over, if J is a union of an increasing sequence of subsets (J„), then CS(J) can be 
naturally identified with the projective limit of the sets CS(J n ). This observation 
leads to the following result. 
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Proposition 1.4.1. There exists a natural bijection between & and the set CS({1, 2, 
of cyclic structures on {1, 2, ... }. 

Note that the bijection of Proposition 1.4.1 identifies p n : & — > S(n) with the 
projection CS({1, 2, ...» -> CS^l, . . . , n}) = 5(n). 

We define the cycles of a virtual permutation x e 6 as the cycles of the corre- 
sponding cycle structure on the set {1,2, . . . }. 

In the second realization of 6 (see §1.3), the cycles of x correspond to those 
subtrees of the rooted tree r associated with x which are one edge apart from the 
root of t. 

In the third realization of 6, the cycles correspond to the orbits of the associated 
map ip of the set {1, 2, . . . } to itself. Here, by definition, two numbers i,j belong 
to the same t^-orbit if there exist k, I, such that (fi k (i) = <p (J)- 

1.5. The groups G and K, and their action on the space &. Set G = 

S(oo) x 5(00). We call G the infinite bisymmetric group. Let K — diagS'(oo) 
denote the diagonal subgroup {(s, s) G G : s e S'(oo)} in G. We shall also use 
parallel notation 

G{n) = S{n) x S(n), K{n) = diagS(n) C G(n). 

Clearly, the group K is isomorphic to 5(oo). We consider 5(oo) as a right 
homogeneous space K\G, where the action of G is defined as follows 

s ■ 9 = 92 ls 9i, s E S(oo), g = (51,52) e G = S(oo) x 5(oo). 

Since the canonical projections p n . n +i are equivariant, this action can be naturally 
extended to the action 6xG^6 defined as x ■ 5 = y, where 

Vn = x n ■ 9 for all n large enough. 

Specifically, this equality holds whenever n is so large that 5 G G already lies in 
G(n). 

Note that G acts on 6 by homcomorphisms. Thus, this is the (only) continuous 
extension of the action of G on K\G to the space S. 

Unfortunately, in all our realizations the description of this action of G is rather 
awkward. Only the action of the subgroup K can be easily described in terms of 
the forth realization of &. Indeed, the action of K on 6 is the only continuous 
extension of its action on 5(00) by conjugations. Under the identification of the 
space & with the space of cyclic structures on {1, 2, ... }, this turns into the natural 
action of K (as a group of permutations of {1, 2, . . . }) on the set CS({1, 2, . . . }). 

1.6. The fundamental cocycle. Given s e S(n), denote by [s] the number of 
cycles in s. It is important for what follows that the difference [x ■ g] — [x] can be 
defined correctly for all x e & and 5 e G. 

Proposition 1.6.1. (i) There exists an integer valued function c(x,g) on & x G, 
uniquely defined by the following property: if n is large enough, so that 5 € S{n) x 
S(n), then 

C{x,g) = [p n (x ■ 5)] - [p n {x)\ = \p n {x) ■ 5] - \p n {x)]. 
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(ii) This function is an additive cocycle: 



c{x,gi g 2 ) = c(x,gi) + c(x ■ g lt . g 2 ). 

(iii) IfgeK, then c(-,.g) = 0. 

Proof, (i) It suffices to prove the claim for g of the form (s, e) or (e, s), where s is a 
transposition (ij) G £(00) . In this case (i) can be easily checked directly. In fact, let 
1 < i < j < n. If i, j are both in the same cycle of x € S(n), then the multiplication 
by (ij) from the left or from the right splits this cycle into two; otherwise the two 
cycles of x containing the elements i and j merge into a single cycle of the product 
x ■ (ij) or (ij) ■ x. On the other hand, if x = p n ,n+i(x), where x e S(n + 1), then 
i,j belong to one and the same cycle of x if and only if they belong to one and the 
same cycle of x. Therefore, \p n (x) ■ (ij)} - \p n (x)\ = [(ij) ■ p n (x)] - \p n (x)] = ±1, 
and this number does not change when n is replaced by n + 1. 
The claim (ii) follows from (i), and (iii) is obvious. □ 

We call c(x,g) the fundamental cocycle of the dynamical system (6, G). 

Remark 1.6.2. Let G D G and K D K be topological groups as defined above in 
§0.1. One can prove that the action of G on 6 can be extended to a continuous 
action 6xG^6. In particular, the subgroup K C G also acts on 6. Moreover, 
all claims of Proposition 1.6.1 hold when G and K arc replaced by G and K, 
respectively. 

2. QUASIINVARIANT MEASURES 

2.1. The G— invariant measure on 6. Recall that 6 = hjniS'(n) is the space of 
virtual permutations, and that we have defined an action of the bisymmetric group 
G = S(oo) x S(oo) on &. In what follows, all measures are Borel measures. 

Proposition 2.1.1. There exists a unique G-invariant probability measure \i\ on 
6. 

Proof. Let yJ{ denote the normalized Haar measure on S(n). Clearly, yJ{ coincides 
with the image of under the canonical projection p n ^ n +i. S(n + 1) — > S(n). 

As n — > 00, the projective limit measure 

m = ym^" 

on & is well defined. It is G-invariant, because the measures fi*, k > n, are 
G(n)-invariant for all n = 1, 2, . . . . 

Conversely, let /x be a G-invariant probability measure on 6. For any n, the 
push-forward of [i under the projection p n : & — > S(n) should coincide with /z™, 
the only G(n)-invariant probability measure on S(n). Therefore, p, = p,\. □ 

Note that the assumption of G-invariance in Proposition 2.1.1 can be replaced 
by a weaker assumption of the invariance under the subgroups S(co) x {e} C G or 
{e} x S*(oo) C G. 

We think of ^1 as of a substitute of Haar measure for the group S'(oo). 
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2.2. Ewens measures fj, t . We shall now include the measure n\ into a one 
parameter family of probability measures {fit}t>o on ©• 

For t > and arbitrary n = 1,2, .. . we define a measure /j™ on by the 

formula 

M {x}) = t{t + i).% + n-iy xeS{n) - 

Here, as in §1.6, [x] stands for the number of cycles in x. The measure /j™ is a 
probability distribution, as it follows from a well-known identity (see Stanley [Sta, 
Proposition 1.3.4]) 



k=i 



c(n, k)t k = t(t + 1) . . . (t + n - 1). 



Here c(n,k) = #{x e S(n): [x] = k} is the absolute value of the Stirling number 
of the first kind. Another proof of this fact follows from 

Proposition 2.2.1. Under the bijection S(n) = I\ x . . . x I n of §1.3, the measure 
fif turns into a product measure fit 1 X fi t 2 x . . . X p, t n . Here fi t m is the measure 
on the set I m = {0, 1, . . . , m — 1} defined as follows 



t+m- 
t 



— , if k = 1, . . . , m — 1, 



t+m-l ' 



if k = 0. 



Proof. Let i(x) — . . . , i n ) e h x . . . x I n be the code of a permutation x € S(n), 
and let Z denotes the number of 0's among the coordinates i\, . . . , i„. By the very 
definition, 

t l 

{lit 1 x [It 2 x ... x /i t ")0(x)) = 



t(t + l)...(i + n- 1) ' 

On the other hand, a coordinate vanishes if and only if the element k creates a 
new cycle of the permutation pk (x) , hence the number of cycles [x] in x coincides 
with the number I of zeros in the vector i(x). This concludes the proof. □ 

Corollary 2.2.2. Given t > 0, the canonical projections p n -i,n preserve the mea- 
sures jU™, hence the measure 

Ht = hm^ 

on & is correctly defined. Under the identification 6 = 7 of §1.3, the measure fi t 
looks as the product measure 

P-t=P-l x fil x ... 



Proof. Indeed, the canonical projection p n -i. n corresponds to deleting the last entry 
i n of the code (ii,i 2 ,. ■ ■ ,i n ) € I\ x ... x I n . This immediately implies the both 
claims. □ 

The measures /x™ on the groups S(n) are known as Ewens measures (see §0.6). 
We will use the same name for the measures fi t on the space S, which are built 
from the measures fif. 
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Proposition 2.2.3. For any t > 0, the Ewens measure Ht is invariant under the 
action of the group K on &. 

Proof. Indeed, it suffices to prove that for any n, the measure Ht on S(n) is in- 
variant with respect to the action of the subgroup K(n) C K, isomorphic to S(n). 
The action under question is simply the action of S(n) on itself by conjugations. 
Since the measure fit on 5(n) has constant weights on conjugacy classes, it is 
invariant. □ 

Since the measures Ht, < t < oo, live on a compact space, it is natural to ask 
for their limits as t goes to or to +oo. 

Proposition 2.2.4. There exist weak limits 

w-lim/it = no, w-lim/i t = ^oo. 

t— >0 t^+oo 

Here Ho is supported by the subset of virtual permutations with a single cycle while 
Hoc is the Dirac measure at the point e € 5(oo) C &. Under the identification 
& = I, both Ho an d Moo become product measures. 

Proof. Let us deal with the realization & = I. Then it suffices to examine the limit 
behavior of the measure fit on J„ = {0, . . . , n — 1}, where n is fixed and t goes to 
or oo. 

When t — > 0, the limit exists and is the measure fio such that 

j$(0) = 0, fiS(i) = ... = fiS( n -i) = J—. 

n — 1 

This means that the finite product measure Ho x • • • x fio , being transferred to 
S(n), lives on maximal cycles in S(n). Therefore, the infinite product measure 
Ho x Ho x • • • on being transferred to 6, lives on the virtual permutations with 
a single cycle in the sense of §1.4. 

When t — > oo, the measure fit tends to the Dirac measure at G /„, which we 
denote as fi£o- This means that the measure on 6 corresponding to the infinite 
product Hoo x x Moo x • • ■ i s simply the Dirac measure at the point x such that 
i{x) = (0, 0, . . . ). This point is just e. □ 

2.3. K invariant product measures on /. 

We can characterize the family of measures Ht as follows. 

Proposition 2.3.1. The measures Ht, < t < oo, are precisely those probability 
measures on & that are both product measures (with respect to the identification 
& = I of subsection 1.3) and invariant under K. 

Proof. Let h be a K -invariant product measure on 6. Clearly, h = )^H n with 
H n = Pnin)- We have to show that h coincides with one of the measures Ht, 
< t < oo. 

Consider the measure fi 1 on S(2). It coincides with some < i < oo, 
and the parameter t is determined uniquely In fact, fito * s the Dirac measure at 
e € S{2), Ho is the Dirac measure at the involution (1,2) e 5(2), and the measure 
fit with < t < oo has weights and at the elements (1, 2) and e = (1)(2) 
respectively. We shall prove by induction in n > 2 that H n = fit f° r a H n - 
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We start by considering the induction step n — > n + 1 in the degenerated cases 
of t = and t = oo. Here we need not the assumption that « is a product measure. 
In the first case we assume that \x n is the uniform distribution on n-cycles in S(n). 
The preimage of n-cycles in S(n + 1) under the canonical projection is the set 
A U B C S(n + 1) where A consists of all n-cycles in S(n) C S(n + 1), and B is 
the set of all (n + l)-cycles. Each of the two sets is a diag5(n)-orbit, and B (but 
not A) is also a diagS^n + l)-orbit. Since u n+1 is diag5(ra + l)-invariant, it is 
supported by B alone and uniform on B. 

The case t — oo is similar. We assume that u" is supported by the point {e}. 
Then the measure is supported by A U B C S(n + 1) where A consists of 

transpositions (n + 1, j), 1 < j < n, and B — {e}. Since A is not S(n + 1) 
invariant, u n+1 is supported by £?. 

Let us now assume that u™ = u™ where t ^ 0,oo. We have to show that 
= u™ +1 . We shall write an arbitrary permutation x € «S(n + 1) as a pair 
{y, j} € S(n) x I n+1 where y = p n , n +i(x) and 



J = 



if a;(n + 1) = n+ 1; 

a;(n + 1) if x(n + 1) ^ n + 1. 



Since is a product measure, 

= "7 ^/"'y 7T, (2-3-1) 

' Vl ;y i(t + 1) ...(i + n- 1) v ; 

where f(0), . . . , v(n) are the weights of a probability measure on I n +i- 

Applying a conjugation by appropriate permutation in S(n) C S(n + 1), one can 
replace any j ^ with any other j' 7^ leaving the cycle structure of y intact. It 
follows that f (1) = . . . = v(n), and we only have to find out the relation of v(0) 
and i/(l) = • • • = v(n). To this end, choose a permutation y £ S(n) such that the 
cycle containing 1 is of length > 2, i.e., y(l) = j 7^ 1. Then 

(l,n+l) -{y, 0}- (l,n+l) = {y',j}. 

Here y' is obtained from y by removing j from its cycle and forming an additional 
trivial cycle (j). An important point is that the initial cycle containing j does 
not disappear completely. It follows that [y'\ = [y] + 1. Since, by the invariance 
assumption, u" +1 ({y,0}) = ({?/, j}), we obtain from (2-3-1) 



Since 
we obtain 



i/(0) +n = 1, 



K0) = v{\) 



t+n t+n 
and the desired identity u™ +1 = u™ +1 follows. □ 



2.4. Disjointness of the measures \i t - 
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Proposition 2.4.1. The measures \i t , < t < oo, are disjoint (mutually singular). 

Proof. We can replace the measures fi t on 6 with the corresponding product mea- 
sures 

oo 

ih = n 

n=l 

on I = Ii x 7 2 x ■ • ■ • Note that jx^ is the Dirac measure at the point i = (0, 0, . . . ) G 
J, and /So is supported by the sequences i — (i\,i2, • • • ) with nonzero coordinates: 
i n =/= for n > 2. Obviously, the measures /i. , /Lt^ and \x t ar e pairwise disjoint, for 
every t G (0, oo). 

Assume now that s,t € (0, oo) and s ^ t. We shall show that /i s and /it are 
disjoint, /U s _L fx t , by applying the well-known Kakutani criterion [Kak]. To this 
end we check that the infinite product Jl^Li fl n, where 



i=0 

diverges. Set u = Vsi; then 

u + n — 1 



i/(s + n-l)(t + n-l) 
=1 + ^— — - + 



Now note that 



n-1 VC"-!) 2 /' 



u-^(s + t) = V^t-^(* + t)^0, 



since s^t. Therefore, the product Il^Li a « i s indeed divergent. □ 
2.5. Quasiinvariance. 

Proposition 2.5.1. Uacft of the measures \x t , < t < oo is quasiinvariant with 
respect to the action of G on the space & . More precisely, 

lH{dx-g) =fc(x , g) , x€egeG (2.5.!) 
Mt(^) 

where c(x,g) is the fundamental additive cocycle of subsection 1.6. The measures 
IIq and /Xqo are not quasiinvariant. 

Proof. It suffices to check that 

IH(V -g) = ( f^midx), geG (2-5-2) 
Jv 

for every Borel subset V C 6. This would imply (2-5-1), hence the quasiinvariance 
of u t . 
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Fix g € G and and choose m so large that g S G(m). For arbitrary n > m 
and y £ S(n), let V^(y) C & denote the preimage of the point y e S(n) under the 
canonical projection p n : 6 — > this is a cylinder set. It suffices to check (2-5-2) 

for V = V n (y). 

Note that V n (y) ■ g = V n (y ■ g) and /J. t (V n (y)) = p?({y}), ncncc 
lH(V n {y) ■ g) = tf{{yg}). 

On the other hand, 

c{x,g) = [p n (x ■ g)} - \p n {x)\ = [y ■ g] -[y]; xe V(y), 

so that 

t c(x,y) = t [yg]-[y\. X G V n (y). 

The equation (2-5-2) takes the form 

tf{{yg}) = t^-W ^({y}), 

which is immediate from the definition of the measure /i". □ 

Using a well-known trick from ergodic theory, one can replace quasiinvariant 
measures (it by invariant, though infinite, measures. In order to do this, consider 
the space 6 = & x Z and define an action of G on 6 as 

(x,k) ■ g = (x ■ g, k + c(x,g)), x e 6, k e Z, .g e G. (2-5-3) 

Define the infinite measure v t on Z as 

i/ t ({fc}) = t~ k , fcez, 

and introduce the infinite measure jit = \i t x v t on 6. 

Proposition 2.5.2. for every < t < oo, the measure fit on the space & is 
invariant with respect to the action (2-5-3) of the group G. 

Proof. This is immediate from (2-5-1) and the definition of the measure v t . □ 

This construction will be used below, see §3.1. 

Remark 2.5.3. One can prove that for every t > 0, the action of each of the 
subgroups S(oo) x {e} and {e} x S(oo) on the space 6 with the measure fit is 
ergodic and topologically minimal (the latter means that every orbit is dense in 
&). These claims will not be used in the sequel. 

3. Generalized regular representations 

In this Section we introduce a family {T z } of unitary representations of the group 
G = S(oo) x S(oo) parameterized by points zeCU {oo} of the Riemann sphere. 
First we assume z <E C* = C \ {0}. 
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3.1. The representations T z . We shall always assume below that the parameters 
t > and z e C* are related as t = zz. By virtue of Proposition 2-5-1, 



^ ( dx ' g) _ *c(x,g) _ |-c(x,a)|2 



Mt (^) 



= t c ^' g > = \z c[ - x ' 9 >Y, x€S, geG. 



Recall that c(x,g) is an additive cocycle, so that 2 c ( x >s) is a multiplicative one. 
Therefore, the following formula allows one to define a unitary representation T z of 
the group G in the Hilbert space H = I? (6 , fi t ) , 

(T z (g)f)(x)=f(x-g)z c ^\ geG, x e 6, Jeff. 

Note two cases when the multiplier z^'S) is equal to 1: 

(1) if z = 1 (then the measure /it = /ii is invariant); 

(2) if z is arbitrary but g E K C G (since c(x, ■) = on the subgroup K). 

By the reasons to be made clear later on we call representations T z the generalized 
regular representations of the group G. 

Remark 3.1.1. The above construction is nothing but a specialization of a well- 
known general construction. Indeed, to any triple (X,G,[i), where Q is a group 
acting on the right on a space X with a quasiinvariant measure fi, one associates 
a one-parameter family of unitary representations acting in L 2 (X, according to 
the formula 

l + is 

(T(g)f)(x) = f(x-g)^^^j , geG, x G X, /eL 2 (X, M ), 
where s £ R is a parameter. When (X, Q, /u) = (6, G, /U t ), we obtain 



fj,(dx) 



where z = t 1+ 2 S . Hence, we return to the definition of T z . 

One can introduce representations T z in a slightly different way, using the action 

g:{x,k) i — ► (x,k)-g = (x-g,k + c(x,g)) 

of the group G on the space 6 = & x Z with the infinite invariant measure jit — 
[it x v t , see Proposition 2.5.2. There is a natural unitary representation T t of the 
group G in the Hilbert space L 2 (6,/i t ), 

(T t (g)f)(x,k)=f((x,k)-g), geG. 



Let T denote the unit circle {£ £ C : |£| = 1}. 
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Proposition 3.1.2. For any t > 0, the representation T t of the group G is unitary 
equivalent to the direct integral 

f T^dO, t = 
of the generalized regular representations T z with \z\ 2 = t. 

Proof. Define a unitary representation of the group Z acting in the space of T t and 
commuting with the latter representation: 

(f (/) f)(x, k) = f(x, k + i) r 1 ' 2 , i e z. 

We claim that the decomposition in question is determined by this commuting 
representation of Z. To see this, we shall pass to a slightly different realization of 

Consider the Hilbert space L 2 (& x T,/i t x d6), where d9 is the normalized 
Lebesgue measure on the circle T (we again write £ = e 27 " e ). In this space, we 
introduce two commuting unitary representations of the groups G and Z, as follows 

(f t (g)f)(x,0 = f(x-g,0 (£>/t) c <**\ g e G, 
(f(0/)(x,£) = .f(x,£)£', leZ, 

where / ranges over L 2 (6 x T,/j ( x d9). 

Clearly, the representation T t admits the required decomposition, which is de- 
termined by the action of Z. Hence, it suffices to check that the representation 
T t x T in the space L 2 (&, Jit) is unitary equivalent to the representation T t x T of 
the group G x Z in the space L 2 {& x T,^ x d9). 

The desired unitary equivalence is provided by the transform T : f i— > /, 

oo 

/(^,o= E /(^r fe/2 r fe , (3-1-1) 

/c— — oo 

which is, in essence, the Fourier transform with respect to the second argument. 

Clearly, T is an isometry. Let us check that it intertwines both representations 
of G: 

OO 

F(Tt{g)f){x,0= £ (ft(g)f)(x,k)t-U- k = 

k— — oo 

oo 

= £ /(z-ff.fc + cO^K^/t)-^ 

A;— — oo 
oo 

= E /(^•5>i)(^)" j+c(x ' s) = 

j=-oo 

= f t (^(/))( a; ,o. 

The intertwining property for the action of the group Z can be checked in a 
similar way. 
□ 
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3.2. Admissibility. The definition of admissible representations is given in §9.9. 

Proposition 3.2.1. All the representations T z , z e C* ; are admissible represen- 
tations of the pair (G, K). 

Proof. Given n — 1,2, consider the canonical projection p n :6 — ► S(n). A 
function Fop n , where F is any function on S(n), will be called a cylinder function 
of feue/ n on the space S. We denote the space of such functions by Cyl"(S), and 
we call 

Cyl(6) = U C y r(6) 

ra>l 

the space of cylinder functions on 6. Clearly, 

Cyl(6)cW = L 2 (6,Mt) 

for every t > 0. 

Note that the canonical projection S(n) — > is invariant with respect to 

conjugations with the elements of the subgroup S m (n) C for all m < n. It 

follows that 

p m (x • u) = p m (ar), x e 6, tie X m . 
Since the factor z c ( x >f) is trivial on the group if C G, we derive that 

Cyl m (6) C W ro . 

The space Cyl(6) is clearly dense in H = L 2 (&, fi t ), hence Tioo is also dense in H, 
and the representation T z is admissible. □ 

Remark 3.2.2. The space Cyl m (6) is strictly smaller than H m . Indeed, the 
former space is finite-dimensional for any m, while the latter space (as we shall see 
later on) has infinite dimension even for m = 0. 

Remark 3.2.3. According to a general result (see §9.9), Proposition 3.2.1 implies 
that the representations T z can be continued to the topological group G. This can 
be verified directly by making use of Remark 1.6.2. 

3.3. Approximations by regular representations. For every n — 1,2, ... 
we denote by H n the finite dimensional space L 2 (S(n)) defined by the normalized 
Haar measure fi n on S(n), and by Reg™ the two-sided regular representation of the 
group G(n) — S(n) x S(n) in this space: 

(Rcg n (g)f)(x)=f(g^x gi ) 

where 

J=(ji,ft)6G(n), x€S(n), f € H n . 

We shall show that every generalized regular representation T z can be obtained as 
an inductive limit of the representations Reg™ determined by an appropriate family 
of isometric embeddings L": H n — > H n+1 , n= 1,2,..., depending on z e C*. 
We define the operators L z : H n -» H n+1 as follows: if / e H n and x e S(n+ 1), 

if x e S{n) C 5(71 + 1); 
(L n z f)(x) = { (3-3-1) 
n±lf( Pn (x)) ifxeS(n+l)\S(n). 

Here and below we assume that t = zz 
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Proposition 3.3.1. For any z G C* the operator L™ provides an isometric embed 
ding H n — ► H n+1 which intertwines the G(n) -representations Reg™ and Reg™ + 
Let T' z denote the inductive limit of the representations Reg™ with respect to the em 
beddings 

r 1 r 2 r 3 

i/ 2 if 3 . . . . 



G(n)- 



TTien tfte representations T' z and T z are equivalent. 

Proof. Note that for every n = 1,2, . .. the subspace Cyl" C H = L 2 (&,fi t ) of 
cylinder functions of level n is invariant with respect to the operators T z (g) where 
g G G(n). This follows from the definition of the representation T z , and the fact 
that for all g G G(n) the function x c(x, g) is a cylinder function of level n: 

c(x,g) = [p n (x) ■ g}-[p n (x)}, xe6, geG(n). 

Since the image of the measure fit with respect to the canonical projection 
p n :& — ► S(n) coincides with fj,f, we can identify the Hilbert spaces Cyl™ C Tt 
and L 2 (S(n), /j"). The operators T z (g) \ Cyl „, where g G G(n), take the form 

(r z (.g)/)(x) = /(x.. 9 )z^]-M (3-3-2) 

(here x G S(n), / G L 2 (S*(n), M ").) 

Define a function F™ on the group S(n) by the formula 

■ \ 1/2 

n! 



^ = U + l)-(* + n-l) J * ' XeS(n) - (3 " 3 " 3) 
Then (3-3-2) can be written in the form 

F?(x-g) 



(T z (g)f)(x) = f(x-g) 



F?{x) 



Note that the function \F z {x)\ 2 coincides with the density of the measure /i™ with 
respect to the Haar measure /x™. It follows that the operator of multiplication by 
the function F z defines an isometry 

Cyl" = L 2 {S{n), /£) — L 2 (S(n), tf) = H n 

intertwining the representations T z | c ln and Reg™ of the group G(n). 
Consider now the commutative diagram 

L 2 (S(n), tf) = C" ► = L 2 (S(n + 1), 



iJ™ - > H n+l 

where the top arrow denotes the natural embedding (lifting of functions via the 
projection p n . n +i), the vertical arrows correspond to multiplication by F z and 
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F z +1 , respectively, and the bottom arrow L™ is denned by the commutativity 
requirement. It follows that if / € H n and x G S(n + 1), then 



(L n z f)(x) = F?+\x) (F^p^x)))- 1 f(p n (x)) 



1 



Since 



\p n (x)] + l if xe S(n) C 5(n + l); 
b„(x)] if xe S(n + 1) \ S(n), 



we conclude that L™ = L™. 

By the very definition, L™ is an isometric embedding which commutes with the 
action of G(n). Hence, the inductive limit representation T' z is well defined. From 
the commutative diagram above we conclude that T z and T' z are equivalent. □ 

3.4. Representations To and Too. 

Proposition 3.4.1. 

(i) For every n = 1, 2, . . . , the isometry L z : H n — > admits a continuous 
continuation, with respect to the parameter zeC, to the points z = and z = oo 
o/ i/ie Riemann sphere C U {oo}. Therefore, the definition of the inductive limit 
representation T' z also makes sense for the values z — and z = oo. 

(ii) The representation T^ is equivalent to the natural two-sided regular repre- 
sentation of the group G = S(oo) x S(oo) on the Hilbert space l 2 (S(co)). 

Proof, (i) Since t = zz, (3-3-1) implies that the limits 

Lq = lim L n z and = lim 171 

z^O |«|-»oo 

do exist, and have the form 

0, if x e S(n) C S(n + 1), 

^f(p n (x)), i£x€S(n + l)\S(n), 



{LZD {*) = 



VW+Tf{p n (x)), ifxeS(n)cS(n + l), 
0, if ieS(n+l)\S(n). 



(3-4-1) 



By continuity, Lq and LJ^ determine isometric cmbeddings H n — > H n+1 commuting 
with the action of the group G(n). Thus, we can use them to construct inductive 
limits Tq, of the two-sided regular representations of the groups S(n) x S(n). 

(ii) For every n = 1,2, .. . consider the map l 2 (S(n)) — > i?" defined as multi- 
plication by the scalar \/nh This is an isometry, since the counting measure on 
S'(n) equals n\ Under identification of both spaces by this map, the embedding 
L 7 ^ turns into the natural embedding l 2 (S(n)) — > l 2 (S(n + 1)). This completes the 
proof. □ 

Using the identification T z = T' z we now may extend the definition of represen- 
tations T z to the values z = and z = oo of the parameter z. In this way we obtain 
a family of representations T z parametrized by the points of the Riemann sphere 
C U {oo}. We have shown that our family forms a continuous deformation of the 
standard two-sided regular representation of G in l 2 {S{co)). This is a justification 
of the term "generalized regular representation" . 
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3.5. A construction of T z via representations Tq and T x . Let us discuss 
now the formula for the isometric embeddings L™ : H n — » H n+1 . We derived 
this formula from the initial definition of the representations T z with z G C*. 
Then, taking a limit transition in the formula, we completed the construction of 
the representations at the points z = and z = oo. 

Here we aim to show that these two steps can be realized in opposite order. We 
start with the definition (3-4-1) of the embeddings Lq and L^, and then pass to the 
general operators L™. First, we have to check that (3-4-1) indeed defines isometric 
embeddings, equivariant with respect to G(n). For L^, this immediately follows 
from the basic property of the canonical projection. As for Lq, we observe that up 
to a scalar multiple, Lq can be defined as lifting along the fibers of the canonical 
projection p n , n +i ■ S(n+1) — > S(n), omitting the natural section S(n) — ► S(n + 1). 
This implies equivariancc. To prove the isometry property, we use the fact that the 
fiber over any point of S(n) consists just of n points, except a single point belonging 
to the section. 

Next, we note that the spaces Lg(if n ) and L'^ Xl (H n ) are mutually orthogonal 
subspaces of H n+1 : the functions in the second space are supported by the subgroup 
S(n) C S(n + 1), and those in the first space are supported by S(n + 1) \ S(n). 

Comparing (3-3-1) and (3-4-1) we see that for z e C*, I" is a linear combination 



of Lq and LI 



Ln V t n i j n 

Vt + n y/t + n 

Moreover, the coefficients of Lq and satisfy the relation 



(3-5-1) 



+ 



VtTn 



n + zz 
t + n 



It follows at once that the operator i™ defined by the formula (3-5-1) is a G(n)- 
equivariant isometry. 

Formula (3-5-1) looks very simple and natural. This is an argument in favor of 
"naturalness" of the representations T z . 



3.6. Connection between T z and Tl 

of inversions in s is finite. Let 



For any s G S'(oo), the number inv(s) 



sgn( S ) = (-If 



±1. 



Then sgn : S(oo) — > {±1} is a (unique) nontrivial one-dimensional representation 
of the group 5(oo). 

Proposition 3.6.1. For every z e CU {oo}, T_ z is equivalent to T z x (sgn x sgn). 
Proof. Given x £ & and g — (.91,32) <= G, let n be so large that g e G(n). Then 

c(x,g) = [g2 1 Pn(x)gi] - [p n (x)}. 



It follows that c(x,g) G 2Z if the permutation g\g 2 1 is even, and c(x,g) G 2Z + 1 
if gig^ 1 is odd. Using the initial definition of T z (for z ^= 0, 00) we derive that 



T_ z (g)= S gn(g ig ^)T z (g). 
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When z = 0,oo, Proposition 3.6.1 claims the equivalence 



T ^ T ® (sgn x sgn), = ® (sgn x sgn). 

Such an equivalence is indeed provided by the operator of multiplication by the 
function sgn(-) (we use the realization of the representations as inductive limits, 
see subsection 3.4). □ 

4. The distinguished spherical function 

4.1. The distinguished vector and the coherent system M z (case z ^ 

0, oo). Assume z € C \ {0} and consider the generalized regular representation T z . 
According to the initial construction of T z in Hilbert space H = L 2 (&,/j, t ) (see 
§3.1), T z comes with a distinguished vector £o : this vector is simply the function 
/o = 1 on the space 6. Clearly, £ is if -invariant and has norm 1. 

In the inductive limit realization of T z as described in §3.3, the same vector £ 
is represented by the functions T" £ L 2 (S(n),n") defined in (3-3-3). 

Note that the whole space of if -invariant vectors in H is infinite-dimensional. 
However, explicitly constructing invariant vectors other than the distinguished one 
is a nontrivial task. 

Let ip z denote the spherical function on the group G corresponding to the dis- 
tinguished vector £ ) let Xz be the related character of the group S(oo), and let M z 
be the corresponding coherent system. We will derive a nice expression for M z . As 
for Xz , it seems that it does not admit a simple explicit expression as a function on 
the symmetric groups S(n). In other words, the Fourier coefficients of the functions 
Xz\s( n ) are simple whereas the functions themselves are complex. 

Recall a standard notation related to Young diagrams. For a particular box 
b e A with coordinates (i, j), the number 



c(b) — j — i and 



is called the content of b. 



Theorem 4.1.1. Let z e C* and t = zz. Consider the coherent system M z — 
{M z } as defined above. For any Young diagram Ahn, 

M 2 (A)= n» f l* + c(»)|* aWA 
zy ' t(t + l) ...(t + n- 1) n! v ' 

where we abbreviate 

M Z (A) = MW(A), A e Y„ . 

Proof. It will be convenient to identify T z with the inductive limit T z of regular 
representations Reg™. Recall that in this realization the representation space is 
defined as the Hilbert completion H of the inductive limit of finite dimensional 
Hilbert spaces H n = L 2 (S(n), /U™). The distinguished vector f belongs to H 1 , 
hence to all of H n . As an element of H n it coincides with the function F z introduced 
in §3. Therefore, for s e S(n) 

1 



Xz\ s{n ) (s) = {Reg n (s,e)F:,F?) = - ^ F?( 8l s) F™( Sl ). 

' «i£S(n) 
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This can be rewritten as 

x*is ( ») = ra* *k, 



where /* (s) = f(s 1 ) denotes the standard involution on the group algebra C[S(n)] , 
and "*" is the convolution product taken with respect to normalized Haar measure 
Mi • 

Note that F™ is a central function on S(n), hence it can be decomposed as a 
sum of characters x A j 

f; = J>(a)x\ (4-1-2) 

Ahn 

where a(A) are appropriate complex coefficients. By virtue of the orthogonality 
relations, 

A, M hn, 

hence 

M Z {X) = |a(A)| 2 . (4-1-3) 

Recall that 

/ | \ 1/2 

z V ; + ...(t + n-i)y V ; 

where [a;] denotes the number of cycles of a permutation x G S(n), see §3.3. We 
arc interested in the decomposition of the central function z^. 

Lemma 4.1.2. Given n — 1,2, ... and z e C*, £/ie decomposition of the central 
function x i— > z^l on i/ie grcwp S(n) afong i/ie characters \ X , Ahn, can 6e written 
in the form 

^En(^))-^ A (-)= 

Ahn be A 

= En^xV). (4-1-5) 

Ahn be A " W 



Keeping together (4-1-2), (4-1-3), (4-1-4), (4-1-5) we get the desired formula 
(4-1-1). Thus, it remains to prove the lemma. 

Proof of the lemma. We switch from central functions on the group S(n) to symmet- 
ric functions. This is done using the classical characteristic map "ch" establishing a 
bijection between central functions on S(n) and homogeneous symmetric functions 
of degree n, see [Mac, 1.7]. It is well known that ch(x A ) = s\, hence we have to 
prove the formula 

<*(* H )=En^(sr--A. 

Ahn be A W 

where s\ are the Schur functions. Let us recall the definition of ch. If F is a 
central function on S(n), p = (l fel 2 fe2 . . . ) is a partition of n, and x p e S(n) is a 
permutation of cycle type p, then 

C hF = Y J ^ 1 F{x p ) Pp . 

p\-n 
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Here z p is the order of the ccntralizcr of x p , 



Zn = 



l fc i 2 k ? ...k x \k 2 \ 



and p p = p^ 1 P2 2 ■ ■ ■ are the monomials in the power sums pi,P2 ■ ■ ■ ■ Note that 
[x p ] = ki + k 2 + ... and k\ + 2k 2 + 3ks + . . . = n. 

Denote by y\, y 2 , ■ ■ ■ a sequence of formal variables of symmetric functions, and 
let u be still another formal variable. One can write 

. . ,.k 1 + k 2 +... „lfci+2fe 2 +... 

i + E*^)--- E lt . 2h ...; !W ... 

n>l 2 fc 2 ... ) 

00 00 ^k„k„,nk / .,_ „,2„ 



n z k p k u nK / 

exp.^f— + -3-+. 



2-1 

(OO \ OO 

^ ln(l - uyi) J = - uyi) -2 . 
i=\ / i=l 

The formula (4-1-6) takes the form 

00 z + c(6) 

JJ(1 - m/;) -2 = JJ rrrr • uy 2 , ...), 

i=l A 6GA ^ 

where A in the right hand side runs over all Young diagrams. Replacing uyi with 
2/i, we arrive at the identity 

nd-^-EIT^-^^---)- (4-1-7) 

2 — 1 A 6£A 



Recall that the coefficients of Schur functions in the right hand side are the 
polynomials in z, hence it suffices to prove (4-1-7) for z = N = 1, 2, .... 
It is well known ([Mac, 1.3, Example 4]) that 

N 

(this is the dimension of the irreducible representation of the group GL(C) with 
the highest weight (Ai, ... , Xn) if Ajv + i = Ajv+2 = • • • = 0, and otherwise). The 
formula (4-1-3) takes the form 



J](l-2/r JV = E s ^ 1 '---' 1 ) ^(2/1,2/2,...)- 
This is a specialization of a more general identity ([Mac, Ch. I, (4.3)]) 



Y[ - u jVi ) 1 = ^2s x (ui,u 2 , . . .) s x (yi,y 2 , ...) 

j=l i=l A 

where we put u\ = . . . = Un = 1 and ujy + i = u^+ 2 = . . . = 0. This completes the 
proof of Lemma 4.1.2 and Theorem 4.1.1. □ 
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4.2. The limit coherent systems Mq and M^. In Theorem 4.1.1 we did not 

consider the parameter values z = and z = oo. However, one can see from (4-1-1) 
that there exist the limits 

M = lim M z , Moo = lim M z , 

z^Q z^oo 

which are also coherent systems on the Young lattice. The coherent system Ma is 
supported by hook diagrams only (see Proposition 4.3.1 (iii) below), and 

M ( ")(A) = ^, A e Y„, (4-2-1) 

is the so-called Plancherel measure. 

According to Proposition 9.5.1 these limiting coherent systems give rise to certain 
characters xo and Xoo of the group 5*(oo), and to certain spherical functions ipo and 

<Ax>- 

Proposition 4.2.1. The functions ipo, ip^ are spherical functions of the repre- 
sentations T = Tq and — respectively. That is, they coincide with matrix 
coefficients of certain K-invariant vectors of the representations in question. 

Proof. In order to sec this, examine the behavior of the distinguished vector £ 
(recall that as an element of the space H n it coincides with the function F z ) as 
long as z — > or z — > oo. 

Set z — r( where r > and ( is a point of the unit circle S 1 C C* . If £ is fixed, 
the limits 

F " = lim F r " c , = lim n = 1, 2, . . . 

exist and have the form 

f v^C if N = 1) i- e -i if a; is a cycle in S(n) of maximal length n, 
\ otherwise; 
f \fn\ ( n if x = e, 
I if x ^ e. 

In these expressions, ( enters as a scalar factor only. Hence the corresponding 
spherical functions do not depend on the choice of £. Clearly, they coincide with 
ipo and (foo, respectively. □ 

Thus, our definition of the distinguished vector £o (§4-1) can be extended to the 
limit cases z — and z — oo — at least, up to an unessential scalar factor. Note 
that the representation Too can be realized in the Hilbert space ^ 2 (5(oo), and then 
£o can be identified with the delta function at e e S(oo). 

Note also that is simply the characteristic function of the subgroup K C G, 
and Xoo is the delta function at the identity element of 5(00). 

We proceed to analysis of the formula (4-1-1). 

4.3. Support of M z . Here we consider the coherent system M z with arbitrary 
zeCU {oo}- The definition of the support of a coherent system is given in §9.4. 
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TO = 



Proposition 4.3.1. (i) If z ^ Z, then supp(M z ) is the whole set Y. 

(ii) // A is a nonzero integer, A = k or A = — k, where k = 1,2, then 
supp(M z ) consists of those Young diagrams A that have no more than k rows, or, 
respectively, no more than k columns. 

(iii) If z = 0, then supp(M z ) is the set of hook diagrams, i.e., Young diagrams 
contained inside the union of the first row and the first column. 

Proof, (i) If z £ Z U {oo}, then the numerator in (4-1-1) does not vanish for all A, 
hence M Z (X) ^ 0. If z = oo, then it follows from (4-2-1) that M (X) (A) ^ 0. 

(ii) Assume that z = k. Then the zeros in the numerator of (4-1-1) correspond 
to the boxes b = (i,j) € A such that c(b) = j — i = —k. These boxes lie on a 
diagonal of A passing through the box (k + 1, 1) in the first column. The lack of 
such boxes in A is clearly equivalent to the fact that A contains k or less rows. In a 
similar fashion, if z = —k then — k + c(b) ^ for all b £ A if and only if A contains 
no more than k columns. 

(iii) Assume that z — and consider the limit Mo = lim^o M z . When z — > 0, 
the zero factor t = zz in the denominator of (4-3-1) cancels with the factor in the 
numerator corresponding to the box b = (1,1) (every nonempty diagram A ^ 
contains this box). Other zero factors in the numerator correspond to the boxes 
(2, 2), (3, 3), ... on the main diagonal. The absence of such boxes just means that 
A is a hook. □ 

If a hook diagram A has arm length a = Ai — 1 and leg length I = X[ — 1, then 



4.4. When the distinguished vector £o is cyclic. 

Proposition 4.4.1. Assume z £ Z, then the distinguished vector £ is a cyclic 
vector of the representation T z . 

Proof. When z = oo, this is evident from the realization in the space ^(S^oo). 
Assume now z E C\Z. 

Since T z is the inductive limit of regular representations Reg™ and £ belongs to 
the spaces H n of all those representations, it suffices to check that £ is cyclic in 
Reg™ for all n. Recall that 



Each of the irreducible representations ir x x 7r A = ir x x (ir x )* of the group G(n) = 
S(n) x S(n) is spherical with respect to diagonal subgroup K(n), and the corre- 
sponding spherical vector is the function x A . Since £ — F z <= H n is a K(n)- 
invariant vector, too, it is cyclic if and only if all of its coefficients in the decom- 
position in functions x A are nonzero. But M z {\) is the square modulus of the 
coefficient of x X , hence the claim follows from Proposition 4.3.1 (i) . □ 

We shall see below that £o is not cyclic in T z if z e Z. 



M (A) = 



|z-Z| 2 ...|z-l| 2 |z + l| 2 ...|z + Q | 
(t + l)(t + 2)(t + 3)...(t + n-l) 



2 dim 2 A 



n! 



Reg" - 0(tt a 




4.5. The equivalence of representations T z and T z . 
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Proposition 4.5.1. The representations T z and T z are unitarily equivalent for all 
z e CU {oo}. 

Proof. If z e R or z = oo, there is nothing to prove. Hence, we may assume that 
z £ R U {oo}, in particular, z £ Z. By virtue of Proposition 4.6.1, it suffices to 
check that (p z — (p z which is equivalent to \z — Xz an d to M z = M z . But this last 
formula follows directly from (4-1-1). □ 

Note that it is not immediate from the definition that T z and T z are equivalent. 

Proposition 4.5.2. Assume that z e C \ Z. 

(i) There exists a unique operator A z intertwining representation T z and T z , and 
identifying their distinguished spherical vectors. 

(ii) Realize the representations T z , T z as inductive limits of representations Reg". 
Then the operator A z preserves the subspaces H n , hence determines an operator 
A n ,z'- H n — * H n commuting with the representation Reg™, for all n = 1,2, .... 

(iii) The operator A n z on the space H n = L 2 (5'(n),^ ra ) is the convolution oper- 
ator with the central function 

Ahn \be\ v V 



Proof, (i) Follows from the fact that the distinguished vectors are cyclic (for z ^ Z) , 
and from the coincidence of the corresponding spherical functions ip z , ip z . 

(ii) Follows from (i) and the fact that the distinguished vector (for z Z) is a 
G(n)-cyclic vector in the representation Reg", for all n = 1, 2, .... 

(iii) We have to find the operator in L 2 (S(n), n") that commutes with the regular 
representation Reg", and transforms the function 



into 




with the same factor C ^ (we do not need its precise form at the moment). 
Every operator commuting with Reg" is a convolution operator with some central 
function 

e = J>(A) x \ 

Note that the convolution operator with the function dim A • % A is the projection 
onto the irreducible component tt x x tt x of the representation Reg". It follows that 

e = e n , z . □ 

4.6. Reducibility of representations T z . For z e CU {oo}, let T z denote the 
subrepresentation in T z realized in the cyclic span of the distinguished vector. In 
other words, T z is the cyclic unitary representation of the group G generated by the 
positive definite function ip z . If z Z, then T z coincides with T z by Proposition 

30 



4.4.1; wc shall sec below that for z € Z it is a proper subrepresentation of T z . Note 
that 

<MfiO = l ; V-i(p) = sgn^iga 1 ), 9= (91,92) & G, 

so that for z = ±1 our representation T z is one- dimensional (more precisely, trivial 
for 0=1 and equivalent to sgn x sgn for z = —1). Moreover, for z = 00 the 
representation is irreducible, since the two-sided regular representation of 
the group G = S x S in / 2 (5) is irreducible. We shall show now that in all other 
cases our cyclic representation T z (hence the entire representation T z ) is reducible. 

Proposition 4.6.1. For every z E C \ {±1} the cyclic representation T z C T z 
generated by the distinguished vector is reducible. 

Proof. Let Xz denote the character corresponding to the spherical function ip z . 
Irreducibility of the representation T z would imply that Xz is an extreme character 
and hence coincides with a certain character x Q/3 from the Thoma list (see the 
Appendix). In this case we would also have the equality M z — M^ a -^ of the 
corresponding coherent systems on the Young lattice. We shall compare the values 
of M z and on one-row diagrams A = (n), n = 1, 2, . . . and derive that the 

equality only holds for z = ±1, 00. 

Indeed, it follows from (4-3-1) that the generating function for M z ((n)), z ^ 0, 00, 

is 

l + ^M z ((n))w n = 2 F 1 (z,z;zz;w), 

n>l 

where w is a parameter. On the other hand, the Thoma formula implies that 

1 + ]T M°e((n))w n = [] T~^~" . 7=1- EK + Pk)- 

Hence, we are led to study the possibility of the equality 

2 F 1 (z,z;zz;w)=e^T\l±^. (4-6-1) 

- LJ - 1 — CtiW 

i 

This formula would also imply that 

2 F 1 (-z,-z;zz;w) = e'* w l[\±^, (4-6-2) 

1 

since the tensor multiplication by the nontrivial one-dimensional representation 
sgn x sgn switches z to — z (by Proposition 3.6.1) and replaces x a ^ with '. 

It is now easy to sec that the equalities (4-8-1), (4-6-2) are only possible if 
z = ±1. In fact, the hypergeometric series converges absolutely in the open disk 
\w\ < 1, hence the right hand side of (4-6-1), (4-6-2) cannot have poles in this disk. 
Recall that all the Thoma parameters are positive, so that there are no cancellations 
between numerators and denominators. Therefore, ct\ = 1 or /3i = 1 or 7 = 1, and 
all other parameters vanish. The first case corresponds to z = 1, the second one to 
z = — 1, and the last one corresponds to z — 00 and cannot occur for a finite z. 

It remains to consider the case z = 0. In the limit z — > the generating function 
takes the form 1 + X)«>i n^" an d the equalities (4-6-1), (4-6-2) cannot hold in this 
case, too. □ 
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4.7. Transition probabilities. Recall from Proposition 4.5.1 that in case z ^ Z 
the support of M z is the entire Young graph. If z = ±k where k = 1, 2, . . . , the 
support is made of the Young diagrams with k or less rows (columns). If z = 0, 
then M z is supported by the hook diagrams. 

Let p z (X, v) denote the the transition probabilities of the coherent system M z , 
see §9... These quantities are defined for any A G supp(M z ). 

Proposition 4.7.1. Let A e Y„, v e Y n+ i, X / v. We have 

dim v 



Poo (A, v) = 



(n + 1) dim A' 



Pz{\v) = \ z+ _° Xv \ Poo (\v), A e Y„ n supp(Mz), z^oo 
zz + n 

where c\ v = c{u \ X) is the content of the box v \ A. 

Proof. Follows immediately from (4-1-1) and the definition of transition probabili- 
ties. □ 

5. The commutant and block decomposition 

5.1. Simplicity of spectrum. Let T z , z e C U {oo} be a generalized regular 
representation. We shall work with the realization of T z as inductive limit of the 
two-sided regular representation Reg™ of the group G(n) — S(n) x S(n). As before, 
we denote the space of the representation Reg" by H n . The representation T z acts 
in the Hilbert completion H of the space (J n>1 H n , where the maps L": H n — > H n+1 
(depending on z) were introduced in §3. It will be important that L" depends 
continuously on the parameter z ranging over the Riemann sphere. Recall that 
Reg™ is the direct sum of irreducible representations 7r A x 7r A , A e Y„ of the group 
G(n). There are no multiple components in this decomposition. 

Denote by P n :H^> H n the orthogonal projection onto H n , by H(X) C H n the 
space of the representation ir x x 7r A , and by P(X):H — > H(X) the orthogonal pro- 
jection onto H(X). Note that the projectors P(X), X e Y„, are pairwise orthogonal, 
and their sum equals P n . 

Let A be the commutant of T z , i.e., the algebra of all bounded operators in H 
commuting with the representation T z . We know that for z ^ Z the representation 
T z admits a cyclic if -invariant vector (the distinguished vector). On the other 
hand, (G,K) is a Gelfand pair [013, §1]. It follows that for z ^ Z, the algebra A 
is isomorphic to the commutant of a commutative operator *-algebra admitting a 
cyclic vector, whence A is commutative. We shall presently give another proof of 
this fact, applicable for all z. 

Proposition 5.1.1. For every z G CU{oo} the commutant A of the representation 
T z is a commutative algebra. 

Proof. We have to prove that AB = BA for arbitrary A, B e A. For every n, the 
operators P n AP n and P n BP n viewed as operators in the space H n commute with 
the representation Reg™. Since Reg™ multiplicity free, its commutant is commuta- 
tive. Therefore, 



P n A P n B P n = P n B P n AP n for all n = 1 , 2, . 
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(5-1-1) 



Since H n C H form an increasing chain of subspaces and their union is dense in H, 
the projectors P n converge to 1 strongly as n — > oo. Moreover, the multiplication 
operation is continuous in the strong operator topology on every operator ball. Since 
the norms of all operators in (5-1-1) do not exceed the maximum of the numbers 
1, ||^4||, ||-B||, we can pass to the limit in (5-1-1), which gives AB = BA. □ 

Corollary 5.1.2. For every z e C, the representation T z is decomposable in a 
multiplicity free direct integral of admissible irreducible representations of the group 
G. 

Proof. The existence of a decomposition into a multiplicity free integral of irre- 
ducible representations follows from the fact that the group G is countable and the 
commutant is commutative. The admissibility is easily checked as in [Oil, Theorem 
3.6]. □ 

5.2. The transition function of T z . In order to simplify the notation, we 
identify the isometric embedding L":H n — > H n+1 with the partially isometric 
operator L"P n in the space H. For every A e Y„, v € Y„+i (where A / v) fix 
an isometric embedding E(X, v): H (A) — ► H{v) commuting with the action of the 
group G(n). The choice of E(X, v) is unique, up to a complex factor of modulus 1. 
We identify E(X, v) with the partially isometric operator E(X, u)P(X) acting in the 
whole space H. 

For each pair of Young diagrams A e Y„, v e Y n+ i consider the operator 
Piy) L" P (A). This operator intertwines representations ir x x tt x and (n v xtt v )\ 
hence is unless A / v. In the latter case it is proportional to E(X, v): 



lG(n)' 



P{v)L n z P(X)=a z {X,v)E(X,v), X / v. 

Set 

Pz(X,u) = MA,^)| 2 , X/v. 

Clearly, this function does not depend on the choice of E(X, v). It is also clear that 
for any £ G H(X) 

l_ 0, otherwise. 

Since the projections P{v), v e Y n+ i are pairwise orthogonal and sum up to P n +i, 
it follows that 

Y,Pz{\v) = l VA e Y„, n=l,2,.... 

We shall call p z (X, v) the transition function of the representation T z . In Theorem 
5.5.1 below we show that it coincides with the transition probabilities of the coherent 
system M z . 

Let us emphasize that the transition function p z {X,v) is defined on the edges 
of the graph Y \ {0}, not the whole Young graph. That is, we do not attempt 
to define the value of this function when A is the empty diagram and v is the 
one-box diagram. 
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5.3. The commutant in terms of the transition function. We shall presently 
show that the transition function of the representation T z determines its commutant 
completely. 

Let A denote the space of all bounded complex functions A(X) on the set of 
vertices of the graph Y \ {0} satisfying the condition 

A(X) = Pz( x > v ) A i v )i for all A e Y, A ^ 0, (5-3-1) 

where v \ A means A / v. We consider A as a Banach space with the norm 
|L4||=sup A L4(A)|. 

Proposition 5.3.1. The commutant A of the generalized regular representation T z 
considered as a Banach space with the ordinary operator norm is naturally isometric 
to the space A. 

Proof. For every operator A e A and every n = 1, 2, . . . we have 

P n AP n = PWAP(n). 

But -P(A) A intertwines the representations tt^ x and ir x x 7r A , hence can be 
nonzero only if A = /i. In this case the operator P(X) A P(X) has to be proportional 
to P(X). Denoting the coefficient by A(X) we obtain 



PnAP n = J2 A WPW- 

AeY„ 

It is clear that 

\\P n AP n \\ = sup \A(X)\ 

which implies that 



P|| =sup||P n AP„|| =sup|A(A)| = \\A(- 

n \£Y 

where \\A( ■ )|| denotes the sup-norm of the function A(X). 
Let us check now that for any A e Y n , v e Y n+ i, 



P(X)P{v)P(X) 



p z (X,u)P(X), \fX/v, 
0, otherwise. 



Indeed, the operator P(y) commutes with the action of G(n) C G(n + 1), hence 
the operator P(A) P(y) P(X) which commutes with the irreducible representation 
7r A x 7r A of the group G(n) should be proportional to P{X). In order to find the 
coefficient we remark that for every £ € H(X) we have P(X) £ = £, so that 



(P(\)P(u)P(\)£,Q = {P(y)t,Q = (PMCPMO = 

Pz{\v) (^,0) if A/ 1 1/, 

0, otherwise 
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by the definition of the transition function. On the other hand, (P(X) £, £) = (£, £), 
so that the above coefficient equals p z {\, v)\i\f v, and otherwise. 
Note now that P(\)P{v)P{n) = if A, // e Y n , fj, ^ A. Therefore, 

P„ P(l/) Pn=Y,P* ( A ' V " G Y «+l • 

Setting 

A n ~ P n A P n , n = 1,2, . . . 
we see that the property (5-3-1) of the function A(-) simply means that 

A n = P n A n +i P n , n = 1,2, ... . 

Thus, we have constructed above an isometric embedding of A into the space A. 
In the opposite direction, we shall show that every function A(-) € A stems from 
some operator A £ A. To this end we set 

A n = J2 A WPW, n=l,2, ... . 

AeY„ 

The condition (5-3-1) then implies that 

An Pn A n +1 Pn, ^ 1> 2, ... , 

and the condition || A{ ■ )\\ < oo implies 

sup || A„ || = ||A(-)|| < 00. 

n 

It follows that there exists a bounded operator 

A = w-liim4„ 

n — >oo 

where w-lim denotes the limit in the weak operator topology. Since A n commutes 
with the action of the group G(n), the operator A belongs to the commutant. It is 
clear that A n coincides with P n A P n for all n, hence our function A( ■ ) corresponds 
to this very operator. □ 

5.4. The multiplication in the space A. Let us denote by (Ao B)( ■ ) the mul- 
tiplication operation of functions A( ■ ), B{ ■ ) in A corresponding to the operator 
multiplication in A. Unfortunately there is no simple formula for this operation. 
Nevertheless, it can be described in terms of the transition function using an ap- 
propriate limit procedure. 

It will be convenient to extend the definition of the transition function p z (X, v) 
to all pairs of Young diagrams A, v. Given A e Y„, v e Yjy, we denote by T(A, v) 
the set of paths 



T = ( T n / T n+ l / . . . / T N ), T n — A, T N = V, 

35 



from A to v in the Young graph (such paths are commonly called skew Young 
tableaux of shape v/X). Let 

N 

Vz(j) = Y[ Pz(Tk-l,T k ) 
k=n+l 

denote the transition probability along the path r, and let 

Pz{X,v)= Pz( T ) 

be the total probability of the transition from A to v. If A is not contained in v, 
then the set T(A, v) is empty and p z (X, v) = 0. If A / v, then the definition of 
p z {X, v) docs not change. 

Let C(Y„) denote the algebra of functions on the finite set Y n , with pointwise 
multiplication. Given n < N, define a linear map 

a N , n : C(Y N ) -» C(Y„) 
as follows: if A( ■ ) e C(Yjv), then 

(ajv,n(^4)) (A) = Pz{\v)A{v). 

vEY N 

Proposition 5.4.1. Assume that A(-),B(-) e A, and let 

A n (-)=A(-)\ Yn , B n (-) = B(.)\ Yn 
denote their restrictions to Yjy. Then 

(AoB)(X)= lim a N , n (A N (-)B N (-))(X), X e Y„, (5-4-1) 

JV— >oo 

Proof. Denote by A,i3 € the operators corresponding to A(-), B(-) and set 
A N = P N AP N , B N = P N BP N . Then 

A N B N = A N {u)B N {v)P{u), 

veY N 

hence 

P(X)A N B N P(X) = a N , n {A N { ■ )B N ( ■ ))(A) 

for all A e Y„. On the other hand, A^Bm converges strongly to AB as N — > oo, 
so that the left hand side converges strongly to 

P(X)ABP{X) = (AoB)(X)P(X), 

which proves (5-4-1). □ 

5.5. The identity of the functions p z and p z . 
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Theorem 5.5.1. The transition function of the representation T z , z G CU{oo} ; is 
given by the same expression as the transition probabilities of the distribution M z , 
i.e., 

Vz{\ V) = -j— r^— ; 7 -7T r, (5-5-1) 

\z\ A + n (n+l) dim A 
where A € Y„ ; t/ € Y„ + i, A / v and c\ v = c{v \ A). 

Remark 5.5.2. If z € Z, the function p z (A, i/) is formally denned on the edges of 
the proper subgraph supp(M z ) C Y only, whereas the function p z (X, v) is always 
defined on the whole graph Y. However, the expression for p z (\,v) given in §4.7 
makes sense for all couples A / v. This makes it possible to say that both functions 
coincide even for zeZ. 

Proof, a) Let us introduce some notation which will also be used in the sequel. 
Let £a, A G Y„, be the vector in H(X) C H n C H corresponding to \ X under 
the identification H n = L 2 (S (n) , fi™) . It has unit length and is i^(n)-invariant. 
The distinguished vector of T z will be denoted as £o as before. As a vector in 
L 2 (S(n), [I™) it is given by the function 

■ \ 1/2 



F ^-\ t { t + i)..: { t + n-^ * w -> x&s ^ 



and can be decomposed as 



where 



AeY„ 

1/2 



bex 

b) We now show that, for every v e Y„ + i, the vector can be decomposed as 

= ^ Ca^, 

A/V 

where the vectors are pairwise orthogonal, _ftT(n)-invariant, 

dimA 

Ua^,^] 



dim i/ 

and generates, under the action of G(n), the representation 7r A x 7r A . 

Indeed, let H(n u ) be the space of an irreducible representation ir" of the group 
S(n + 1), and let End H{-k u ) be the algebra of operators on this space. Endow 
End H(ir' / ) with the inner product 



dim v 

and define an action of the group G(n + 1) on End H{-k") by 



g-A = ^( 9l )A^{g 2 )-\ A e End H(-k u ), g = {g u g 2 ) e G(n + 1). 
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It is convenient to identify the vector spaces EndiJ(7r !/ ) and H(y) C H n+1 — 
L 2 (S(n+l), as follows: to an operator A e EndH (tt") we assign the function 

A(s) = tr(An' / (s^ 1 ). The map A A preserves the inner product and commutes 
with the action of the group G(n + 1). 

Let l v denote the identity operator in the space H(n v ). Its image under the 
correspondence A i— > A coincides with the vector £„. Further, for any A /" i>, let 
1 \ v E End H (tt v ) denote the orthogonal projection onto the subspace of vectors that 
transform according to the representation 7r A under the action of S(n) C S(n +1). 
Define ^xv as the image of the operator lx v under the correspondence A i— » A. 
Clearly, the vectors satisfy all the required properties. 

c) Now let us remark that it suffices to prove (5-5-1) when z ^ Z. In fact, 
the right-hand side of (5-5-1) is continuous in the parameter z ranging over the 
Riemann sphere. It also follows from the definition (5-3-1) of p z (X, v) that this 
function is continuous in z, since so is the map L™. 

The assumption z ^ Z implies that a z (X) ^ for all A, which will be used in the 
computation below. 

d) Equating the decompositions of £o m £a, A <G Y n , and in £„, v £ Y n+ i, we 
conclude that 

£o=^]a z (A)£ A = 53 a z(v)&- 



agy„ 



Substituting the decomposition = J2xyv £ai>j we arr i ye at 
53 "zWZx = 53 53 

AeY„ AeY„ v\X 

Comparing the components in both sides that transform according to a given irre- 
ducible representation of G(n) C G(n + 1) we see that 



a z (A)?A = 53 a z( v )^v 



for any A e Y„. 



This implies that 



whence 



r v t,\ = 77T?Ai/, 



a* (A) 



Vz{\v) 



a z {v) 



a z {\) 



a z {v) 



a z {\) 



dim A 
dim v 



by the definition of the transition function. This last equation, along with the ex- 
plicit formula for the coefficients a z ( ■ ), implies the desired formula for p z (X, v). □ 

5.6. The subgraphs Y(p, q) and levels of Young diagrams. Given a couple 
(p, q) of nonnegative integers, we define a subset Y(p, q) C Y as follows 



Y(p,q) = {\eY\(p,q)e\, (p+l,q+l) £ A}, p,q>l 
Y(p,0) = {A e Y | A p+1 = A p+2 = • • • = 0}, p > 1 
Y(0, q) = {A e Y | (A'),+i - (A'),+2 = • • • = 0}, q > 1 
Y(O,O) = {0} 
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In other words, the set Y(p, q), where p, q > 1, consists of all diagrams containing 
the rectangle of shape px q but not the box (p + 1, q + 1). The set Y(p, 0) consists 
of all diagrams with at most p rows, and the set Y(0, q) consists of all diagrams 
with at most q columns. 

Each Y(p, q) may be viewed as a connected subgraph of the Young graph. 

Proposition 5.6.1. Fix an arbitrary integer k and remove from the Young graph 
all edges A / v such that the content of the box u\X equals —k. Then we obtain a 
subgraph in Y whose connected components are exactly the Y(p, q) 's with p — q = k. 

Proof. This follows from the three claims which are readily checked. First, the sets 
Y(p, q) with fixed p — q = k form a partition of the set of all Young diagrams. 
Second, if A f v and c(v \ A) 7^ k then A and v belong to one and the same part 
Y(p, q) of that partition. Third, if A /* v and c(y \ A) = k then A and v belong to 
different parts: specifically, if A e Y(p, q) then v e Y(p + l,q + l). □ 

For an arbitrary k <E Z, we define the k-level of a Young diagram A as follows 

lev fc (A) = #{6e A I c(b) = -k}. 

In other words, lev (A) equals the length of the main diagonal in A, and levfe(A) is 
the number of boxes on the diagonal shifted (with respect to the main diagonal) k 
boxes downwards if k > 0, and |fc| boxes upwards, if k < 0. 

Proposition 5.6.2. Fix an arbitrary integer k. The partition of the set Y into 
disjoint union of the sets Y(p, q) withp—q = k coincides with the partition according 
the value of the k-level. Specifically, a given part Y(p,q) with p — q = k is exactly 
the set of diagrams with levfc( ■ ) = I, where I — min(p, q). 

Proof. This is evident. □ 

5.7. The decomposition into blocks. 

The knowledge of the transition function p z (A, is), and the results of Propositions 
5.3.1 and 5.4.1 lead us to a preliminary decomposition of representations T z for 

z e z. 

Define a function A pq { ■ ) on nonempty diagrams as follows. If p, q = 1,2,... 
then this is the characteristic function of the set Y(p, q). If p = 1,2,... and q = 
then this is the characteristic function of Y(p, 0) \ {0}. Similarly, if p = and 
q = 1,2, . . . then this is the characteristic function of Y(0, q) \ {0}. 

Theorem 5.7.1. Fix k e Z and let (p,q) be a couple of nonnegative integers, not 
vanishing simultaneously, and such that p — q = k. 

(i) The function A pq {-) satisfies the condition (5-3-1) involving the transition 
function p^{\,v). Therefore, it determines an operator A pq in the commutant A of 
the representation T^. 

(ii) Any operator A pq is an orthogonal projection onto a subspace H pq C H . 
The subspaces H pq are pairwise orthogonal, and their direct sum is the whole H. 
Thus, they determine a decomposition of the representation Tk into a direct sum of 
subrepresentations, 

Tk= © T pq , (p,q) eZ^\{(0,0)}. 

p—q—k 
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(iii) Denote by Reg™ g , where n is large enough, the subrepresentation of the 
regular representation Reg™, which is the union of the components n x x tt x such 
that A € Y(p, q). Let H pq be the corresponding subspace in H n . Then the isometric 
embedding LJJ : H n — > H n+1 maps H pq into H™^ 1 , and the representation T pq C Tk 
coincides with the inductive limit of the representations Reg™^ C Reg" as n — > oo. 

Proof, (i) For A e Y„ n Y(p, g) we have a chain of identities 

A pq {\) = l=^p k (\v) = Pk{\v) = X] Pk{\v)A pq (v). 

v\,\ v\\,u£Y(p,q) v\\ 

Therefore, the function A pq (-) satisfies the condition (5-3-1). Since this function 
is bounded, it determines, according to Proposition 5.3.1, an operator A pq in the 
commutant A of the representation TV 

(ii) From Proposition 5.3.1 and the definition of the function A pq ( ■ ) it follows 
that for all n = 1, 2, . . . 

P n A pq P„ = ]T P(A). (5-6-2) 

AeY„nY(p,g) 

Since P n A pq P n is an orthoprojector for any n, so is the operator A pq . A similar 
argument shows that the projectors A pq are pairwise orthogonal and sum up to the 
identity operator. Note that here we could also use Proposition 5.4.1. 

(iii) Since all three operators P n , A pq , P n A pq P n arc orthoprojectors, it follows 
that P n and A pq commute. Along with (5-6-2) this implies that the operator 
P n A pq = A pq P n projects H n onto the invariant subspace H pq . Since P n +i majorizes 
P n , we see that H pq is a subspace of H^ 1 . □ 

We shall call the subrepresentations T pq C Tk the blocks of the representation Tk. 
We shall show below that the blocks are themselves reducible, and find their decom- 
position into a direct integral of irreducible representations. The only exceptions 
are the one-dimensional blocks Tio C T\ and Toi C T_i: each one is generated 
by the distinguished spherical vector. The block T\q is the identity representation, 
and Toi is sgn x sgn. 

5.8. Another approach to decomposition into blocks. It is worth noting that 
the decomposition of the representation Tk, k e Z, into blocks can be obtained in 
a different way - using the operator A z intertwining representations T z and T s . 

Recall that the operator A z was described in §4.7 as inductive limit, as n — > oo, 
of certain operators A rlyZ : H n — > H n commuting with the representation Reg". In 
other words, A z preserves H n for all n = 1, 2, ... , and the restriction of A z to H n 
is A n ^ z . The operator A„ jZ acts in the space H n = L 2 (S(n), /z") as the operator of 
convolution with the central function 

on the group S(n) (see Proposition 4.7.1). 

This function is correctly defined for all nonintegral values of the parameter z. 
If z e R\ Z, then the function Q n ,z is just 8 e = ^2 X hn dim A • x A , the delta function 
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at the identity element of the group S(n). Therefore, the associated operator is 
simply the identity operator in H n . Let us see what happens to 6„ jZ when the 
parameter z e C \ R approaches an integer point k e Z. It turns out that there 
exists a nontrivial limit of 0„. z , depending this time on the direction in which z 
approaches k. 

In order to see this, set z = k + sw, where w ^ is a fixed complex number and 
e is a real number going to 0. Set u — w / w. Then one can easily see that 

lim O ntZ = u '° Vfc (A) dim A ' X X ■ 

Ahn 

Denote by A n _k(u) the convolution operator with the latter function. Clearly, for 
each fixed u, \u\ = 1, the sequence of operators (A ni k(u)), n = 1,2, . . . , is consistent 
with the embeddings L£ : H n — > H n+1 and hence determines an operator Ak{u) in 
the space H of the representation Tfc, commuting with this representation. 
On the other hand, 

A k(u)\ = u l ■ 1, l = mm(p,q), 

pq 

which implies that 

p—q—k 

i.e., Ak(u) can be considered as a generating function of the projectors A pq . One 
can derive from this fact another proof of Theorem 5.6.1, not relying on Proposition 
5.3.1. 



6. The invariant vectors 
Let us outline the contents of the present Section. 

We start with arbitrary z and describe a convenient realization of the space V z C 
H(T Z ) formed by if-invariant vectors. Specifically, we show that V z is isomorphic 
to the space T z of functions on Y that satisfying two conditions: a harmonicity 
type condition and a Hardy type condition. In these terms, if z is an integer, the 
splitting of the space V z induced by the block decomposition T z = © p _ 9=z T pq 
takes especially nice form. 

Then we focus on the case when z is an integer. We prove two main results: The- 
orems 6.2.1 and 6.2.2. In Theorem 6.2.1 we construct, for any block T pq , a certain 
if-invariant vector v pq . In Theorem 6.2.2 we compute the spectral decomposition 
of the corresponding spherical function: we show that the spectral measure lives 
on a finite dimensional face f2(p, q) of the simplex 0. 

Later on in §7 we shall show that, for any couple (p, q), the vector v pq is a cyclic 
vector in T pq . This allows us to completely understand the spectral decomposition 
of T z at the integer points z. 

6.1. The space T z . Recall that the vectors £\ were introduced in §5.5 (see the 
proof of Theorem 5.5.1, part a)). 

Proposition 6.1.1. For any n = 1, 2, . . . and any A € Y„, v e Y„ + i, 

^ ^ j = f (z + c Xv )/y/(t + n){n + 1), if\/v 

i 0, otherwise, 
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where, as before, c\ v is the content of the box vj\, t = \z\ 2 . 

Proof. The inner product (Oo^) is a continuous function in z, hence it suffices to 
prove the formula under the assumption z ^ Z. In this case (£oj£a) 7^ for all A. 
Indeed, this follows from the equality (£o>£a) = a z (X) and the explicit expression 
for a z (X), see the proof of Theorem 5.5.1, part a). 

Denote by Q\ the projection operator from the Hilbert space H of the repre- 
sentation T z to the subspace of all vectors that transform, under the action of the 
subgroup G(n), according to the representation 7r A (X) 7r A (that is, the range of Q\ 
is the isotypical component of 7r A ® n x in T z \g(u))- Notice that P(X) < Q\ and 
Qa£a = It follows from the proof of Theorem 5.5.1, part b), that 



dim A/ dim v, \i\/v 
0, otherwise. 



In particular, if the condition A /* v docs not hold then Q\^ v = and £„) = 0. 
Consider the decompositions 



A£Y„ i/£¥„ + i 

Applying the operator we derive 

v\X 

Fix a diagram v such that v \ A. Taking the inner product with £„ we obtain 

We have used here the relation (Q\£,v',£,u) = for any z/ e Y n+ i \ {v}, which in 
turn follows from the fact that Q\H{v) C H{v) for any v e Y n+ i. 
Now remark that 

(Qx^,^) = (Qx^,Qx^) = ^^, 

and hence 

Since (£o>£a) 7^ this implies 

(Co, £a) dim!/ a z (A) dimz/ 

Substituting the explicit expression for a z ( ■ ) (see the proof of Theorem 5.5.1 part 
a)) concludes the proof. □ 
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Definition 6.1.2. Denote by T z the space of complex-valued functions /(A) on 
the vertices A 7^ of the Young graph, satisfying the following two conditions, 
(i) Pseudoharmonicity: for any AeY„,n=l,2,..., 



„\a „\a V(* + n)(n + l) 

(we have used here the formula of Proposition 6. 1.1). 8 
(ii) Hardy type condition: for any n = 1,2,... 

||/|| 2 :=sup^ |/(A)| 2 <^. 

" AG¥„ 

It is worth noting that for any / satisfying the pseudoharmonicity condition, the 
sum J2\eY n l/(A)| 2 does not decrease, as n — > oo (this follows from the proof of 
Proposition 6.1.3 below). This shows that we could equally well define the norm 
ll/H by the formula 

||/|| 2 = lim ]T |/(A)| 2 . 

n— ►oo * — ' 

Proposition 6.1.3. Let V z be the subspace of K -invariant vectors of the repre- 
sentation T z . Then the map 

vi-^fv, fvW = {v,£ x ) 

provides a linear isomorphism V z —^T z , preserving the norm. 

Proof. Recall that by P n we denote the orthogonal projection from H = H(T Z ) 
onto H n . Denote by V n the subspace of if(n)-invariant vectors in H n . Note that 
V n is not contained in V z , but P n V z C V" and P n V n+1 C V n . The vectors £ A , 
where A e Y„, form an orthonormal basis in V n . Given two vectors 

v n = £ <*(A)& G V n and u n+1 = E e V™+\ 

AGY„ i/£¥„ +1 

we have 

u„ = P„^ +1 a(A)= ^ 6(1/) V A e Y„ . 

y\A 

Note that these relations imply that 

E KA)| 2 = |k|| 2 <|k +1 || 2 = E l 5 ( A )l 2 - 

Assume now that v € V z and v n = P n v for n = 1,2,.... Then 

/„(A) = {v,t\) = (v n ,£ x ), n=\\\. 



8 Cf. the definition of harmonic functions on Y, see the end of §9.3 
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The above argument shows that the function /„ satisfies the pseudoharmonicity 
condition and 



||/,|| 2 :=sup|K|| 2 = lim Kf = |h>f < °o, 

hence f v G T z . Therefore, the function provides an isometric embedding 

V Z ^T Z . 

Let us show now that the map is surjective. Given an arbitrary / <G T z , we set 

« n =5Z/(A)^, n=l,2,.... 

AeY„ 

Then v n G V n , u„ = P„v„+i and 

lim \\vnW 2 = sup||u„|| 2 = Il/H 2 . 

n^oo n 

Therefore, the vectors v„ converge to a vector v G H(T Z ). For every m the vector 
w is isf(ra)-invariant, because the vectors w„ possess this property for all n > m. 
Hence, v G V z and it follows that / = /„. □ 

6.2. Two theorems. We assume from this point to the end of §6 that z is an 
integer and we write z — k. Recall that in §5 we have introduced invariant subspaces 
H(T pq ) C H(Tk) (with the indices p, q subject to the condition p~q = fc), called the 
blocks. Denote by V pq — V fl H{T pq ) the subspace of all X-invariant vectors in the 
block H{T pq ). Let T pq be the subspace in Tk formed by the functions supported 
by Y(p, q) C Y. The decomposition 

p— q —k 

is parallel to 

Vk = v p „ 

and the latter corresponds to the decomposition 

H(T k ) = H{T pq ), 

p—q=k 

of §5. 

Our goal is to produce a certain vector v pq G V pq , which will be described in 
terms of the realization V pq = T pq . The following encoding of a Young diagram 
A G Y(p, q) will be convenient. Recall that A belongs to Y(p, q) if and only if A 
contains the rectangle of shape p x q (p rows and q columns) but not the box 
(p + l,q + 1). One can represent such a diagram as union of three parts: the 
p x g-rectangle, a diagram A + to its right, and a diagram below the rectangle. The 
transpose of the latter diagram will be denoted by A~. Formally: 

X + = (Xf, ... , A+), where Xf = \ { — q, 1 < i < p; 

A" = (Af, . . . , A~ ), where Xj = (A')j -p, 1 < j < q. 

If q = then A^ — and A = A + . Likewise, if p = then A + = and A = (A~)'. 

If both p, q are nonzero then the correspondence A (A+,A~) establishes a 
bijection between the sets Y(p, q) and Y(p, 0) x Y(q, 0). 

Below we set n = |A|. 
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Theorem 6.2.1. Let z = k be an integer and let T pq be an arbitrary block of the 
representation (recall that p, q are nonnegative integers such that p — q = k and 
(p,«)^(0,0) ifk = 0). 

In the space H(T pq ) there is a K -invariant vector v pq , such that the corresponding 
function f pq (X) — f Vpq {ty in the space T pq C T z of functions on the graph Y(p,q) 
has the following form 

x II (Xt-Xj+3-i) II (K-K+'-r), 

l<i<j<p l<r<s<q 

where n= |A|. 

In the next theorem we use the concept of spectral measure; it is explained in 
§9.7. We also need the finite-dimensional faces f2(p, q) C f2, which are defined in 
in §9.6 (f2(p, q) is a simplex of dimension p + q — 1). 

Theorem 6.2.2. Let v pq be the vector defined in Theorem 6.2.1, let 
, n ( x (T z (g)v pq ,v pq ) (T pq (g)v pq ,v pq ) 



be the corresponding spherical function on the group G, and let a pq be the spectral 
measure on fi, corresponding to Lp pq . 

The measure a pq is supported by Cl(p, q) C and has the density 



\v. "- 2 



l<i<j<p l<r<s<q 



with respect to Lebesgue measure on ft(p,q). 

In order to prove these two theorems, we need a few lemmas. 
6.3. Preparatory Lemmas. 

Lemma 6.3.1. Let p= 1,2,... be fixed. The function g p (X) on the graph Y(p,0) , 
determined by 

9p( x ) = II ( A *~ A J +3- i )i 

l<i<j<p 



satisfies the relation 



(p 2 + |A|) 5 P (A) = (p + cxu) g P {y). 



Proof. By setting 



k = \i+p-i (i = l,...,p), \l\ = h + . . . + l p , 
V(l u ...,l p )= J] {h-lj), 
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we transform the relation to the form 
p(p - !) 



P 2 



V(h, ... ,l p ) = J2(k + l)V(h,... ,k + l,... ,l p ). 



The sum extends over all indices i = 1, ... ,p, not just those with k-i > k + 1, 
because in case of k-i = U + 1 the term V(l\, ... , h + 1, . . . , l p ) vanishes. 

Let us check the latter relation. The right hand side, being a skew symmetric 
polynomial in li, ... ,l p , is divisible by V{1\, ... ,l p ). Since its highest term is 
\l\ V(li, ... , l p ), the right hand side has the form 

{\l\+const)V(h, ... ,l p ). 

In order to determine the constant, we specialize the identity 

p 

J2(h + l)V(l u ... ,h + l,... ,l p ) = (|Z|+ const) ... ,l p ). 
i=i 

at 

(h,l 2 , ... ,l p ) = (p-l,p-2, ... ,0), 

Then we obtain 

pV(p,p-2,p-3,...,0)= +const^ V(p - l,p - 2, . . . , 0), 

whence 

2 p(p-i) + 

const = p = , 

and we are done. □ 

Remark 6.3.2. One can suggest another proof of Lemma 6.3.1. It is seemingly 
more round about, but better explains the origin of the result. The idea is that in 
case of p = k, q — we already dispose of an example of a pseudoharmonic function 
on the Young lattice Y(p, 0): the function 

&(A) ((^) 1/2 ^=r U(p + < b ^ n = \ x \ 

(cf. the proof of Theorem 5.5.1, part a); in this setup t = p 2 ). Since 

dim A V(h, ... , l p ) 



and 



we obtain that 



n! h\...l p \ 

h\...l p \ 



(p- 1)!...0! ' 



1 / n\ \V2 

^ (A) = ( P -1)!...0! KWTJ 5p(A) ' 
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and the required relation for <7 P (A) follows from the pseudoharmonicity condition 
for<7 p (A). □ 

Using Lemma 6.3.1 and the fact that the graph Y(p, q) is isomorphic to the 
product Y(p, 0) x Y(q, 0) we will produce a pseudoharmonic function on Y(p, q). 

Let (x n ) n > pq be a sequence of positive real numbers satisfying the recurrence 
relation 

x n +l n + p 2 + q 2 -pq 



x n ^(n+(p-q) 2 )(n+l)' 

For instance, one can set 

T(p 2 + q 2 - pq + n) 
x n = — ; (6-3-1) 
^r((p-q) 2 +n)r(n+l) 

Below we use the correspondence A i— ► (A + , A - ) introduced in §6.2. 

Lemma 6.3.3. Letp, q be nonnegative integers, (p, q) ^ (0, 0). The function f pq (\) 
on the graph Y(p, q) determined by the formula 

fpq{x)={ -^— n ( x t- x i+j-*) n (k-k+s-v), 

l<i<j<p l<r<s<p 

satisfies the pseudoharmonicity condition with the parameter k = p — q, i.e., 

, , . x _ P - g + C\U , ,s 

„\\ V((p-q) 2 +n){n + l) 

for any A G Y(p, q)f]Y n . 

In this formula we assume that v belongs to Y(p,q). However, the formula 
remains true without this assumption, because if A / v, A € Y(p, q), and v Y(p, q) 
then the factor p — q + c\ v vanishes. 

Proof. Assume first that both p and q are positive. In the notation of Lemma 6.3.1, 
f pq (\)= { —2 g p (\+)g q (\-). 

Xn 

Let v € Y(p, q) denote a Young diagram with n + 1 boxes. The condition A / v 
implies one of the following two conditions: 

(i) A+/^+, \-=v~] 

(ii) X+ = u+, \~ / v~ . 



Note that 



Therefore, 



p- q + c\ u 



Q + c \+v+i m case (i), 
— p — C\- v - , in case (ii). 



P + c \+v+, hi case (i), 

-(? + c\-v~), in casc (ii)- 
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It follows that 

^(p - q + c Xv ) f pq {u) = 

^+\a+ Xn+1 
+ E — (9 + CA-,-).9 P (A + ).g 9 (^). 

_ X n +1 
v \A 

In the first sum \v~\ = \X~\, and in the second one \v~\ = |A _ | + 1. Hence, the 
sign in both formulas is (— 1)' A L 

Applying the Lemma 6.3.1, we derive that the last expression equals 



(-1) 



|A-| 



(p 2 + \\ + \+q 2 + \\-\)g p (\+)g q (\-) = 



X n +1 

We have shown that 



X n +1 

"™ -(p 2 + q 2 +n-pq)f pq (\). 



*22(p-q + C\ v ) f pq {v) = -^—(p 2 + q 2 + n-pq) f pq {\). 



X n +l 



Dividing both sides by y/{n + (p — q) 2 )(n + 1) we obtain that the coefficient of 
f pq (X) in the right-hand side equals 



p 2 + q 2 + n - pq 



xn+i ^(n + (p-q) 2 )(n + l) ' 

which is 1 by definition of the numbers x n . The lemma follows. 

If q = or p = 0, our relation is simply equivalent to Lemma 6.3.1. □ 

Lemma 6.3.4. The function f pq (X) introduced in Lemma 6.3.3 satisfies the Hardy 
type condition of Definition 6.1.2. Hence, f pq G T pq . 

Proof. In order to simplify the notation, set a = A + , b = A - , i.e., 
ai = .. ,a p = A+; h = Aj~,. .. ,b q = X~ . 

When A ranges over Y(p, q) n Y„, the couple (a, b) ranges over the subset in Z+ +9 
determined by the conditions 

ai > . . . > a p , b\ > . . . > b q , ^ a, + ^ b 3 ■ = n - pq. 

We now have 

E I^WI^^E II (^-aj+j-i) 2 J] (b r -b s + S -r) 2 . 

A6Y(p,g) ™ a,b l<i<j<p l<r<s<p 

\\\=n 
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Assuming here n > pq, we set 

L n (X) = (a; (3) = (ai, . . . , a p ;/3i, (3 q ), 

where 

ai a p bi b q 

at = ,...,a p = ; (h = ,...,p q = . 

n — pq n — pq n — pq n — pq 

The vector (a; (3) belongs to the lattice n ^ lF+ q and satisfies the conditions 

ai>--->a p , Pi>--->(3 q , ^(Xi + ^pj = 1. 
In terms of (a; (3), the expression for ^ |/ Pg (A)| 2 can be written as 

n «*-<*>■ n (i + o(i)). 

™ (a;/3) l<i<j<p l<r<s<« 

summed over all (a; (3) subject to the conditions stated above, that is, over the set 

n(p,g)n(— J— 

\n — pq J 

where g) is the simplex introduced in §9.6. 
From the well-known formula 

F ( n + COnSt ) „ n const 

r(n) ' ' 

we get 

x n ~ n p 9 P9 2 = n 2 , 
hence the coefficient in front of the sum has the asymptotics (as n — > oo) 

n p(p-l)+ 9 ( 9 -l)-(p 2 +g 2 -l) _ n -(p+g-l)_ 

But p + g — 1 is exactly the dimension of fl(p, q), hence we have 

Jim l-M A )| 2 = / II («i-^) 2 II (/3r-/3 s ) 2 ^, 

n_> °° AeY( P>9 )nY n u=( a J)en( P , q ) l <*<i<*> i<r<s< P 

where dto is Lebesgue measure on Q(p, q). Since the integral in the right-hand side 
is finite, we conclude that the Hardy type condition is satisfied. □ 
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6.4. Proof of Theorems 6.2.1 and 6.2.2. The definition of the function f pq (X) 
in Theorem 6.2.1 is identical with that given in Lemma 6.3.3. By virtue of Lemmas 
6.3.3 and 6.3.4, the function f pq belongs to T pq . Therefore, it determines a K- 
invariant vector v pq G H(T pq ), which concludes the proof of the theorem. 

Let us turn to Theorem 6.2.2. Compare two probability measures on Y„. 

The first measure, denoted as M pq ^ , comes from the coherent system correspond- 
ing to the spherical function ip pq introduced in the statement of Theorem 6.2.2, 



M («)(A) = M^i A G Y n . 

By the general theory (see Theorem 9.7.3), the spectral measure a pq is the weak 
limit of the measures t n (M pq ^), where i n : Y„ — >■ £7 is the embedding defined just 
before Theorem 9.7.3. 



The second measure, which we denote as M pq , has the form 



h£? w . ««#£ - mw, A € Y„ 



(n) 

where v pq = P n v pq is the projection of v pq onto the subspace H n , and the projection 

i n \ 

Q\ was defined in §6. 1 . We know that M pq is concentrated on the subset Y„ (p, q) = 
Y(p,q)DY n . 

Below we use the standard norm on signed Borel measures: given such a measure 
H, its norm \\fi\\ is defined as the variance of fi + plus the variance of where 
fi = p + — p- stands for the Jordan decomposition of yU. 

Lemma 6.4.1. We have 

?("), 



\\M^-M p n '\\^0, 



oo. 



Proof. Indeed, as is well known, for any two probability Borel measures [ii,p2, 
defined on one and the same Borel space, 

|| Mi - HI < 2sup|/zipf) - /U 2 (X)|, 
x 

where the supremum is taken over arbitrary Borel subsets. Let us apply this in- 
equality to pi — Mp\f \ (j,2 = M p n q \ To simplify the notation, set 

a-n^ir 1 ^, 6 = n^ ) ir 1 ^ ) 

and, for any subset IcY„, set 



xex 

The operators Q\, with A ranging over Y„, are pairwise orthogonal projectors whose 
sum equal 1, whence ||<5x|| < 1 f° r an Y X. It follows 

||MW-M^||<2 sup <4||6-6II- 

XC¥„ 
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But ||£i — ^2 1| - * as n — > oo, because ||u pg — ?4^| — » 0. This completes the 
argument. □ 

On the other hand, it follows from the proof of Lemma 6.3.4 that the measures 
T n (M pq ) on fi(p, (?) weakly converge to a probability measure, which is absolutely 
continuous with respect to Lebesgue measure on fl(p, q) and whose density is exactly 
as required in the statement of the theorem. 

Lemma 6.4.2. The measures t n (M pq ) on Q weakly converge, as n — > oo, to the 
same limit measure concentrated on Q(p,q). 

Proof. Indeed, let us compare the two embeddings, 

I n : Y n (p, q) — > g) C O and i„ : Y„(p, q) — > O. 
For any A € Y n (p, g), we can write (viewing i n (A) as an element of 51) 

r„(A) = (ai,a 2 , • • • ;0i,P2, ■ ■ ■ ), 



where 

and similarly 
where 



«p+l — Cip+2 — ■ ■ ■ — Pq+l — Pq+2 — ■ ■ ■ — 0, 

L n (\) = (ai,a2,...;/3i,/3 2 ,...), 



otd+i = a d +2 = ■ ■ ■ = Pd+i = fid+2 • • • = 0, d = max(p, q). 

Further, from the definition of l n {\) and t n (X) it follows that for any fixed i, j, 

const - const 

\ai-ai\<—— , \[3j - /3j\ < — — 

where the constant does not depend on A. Consequently, if F is an arbitrary 
bounded continuous function on ]R°° x R°° depending on finitely many coordinates 

(„) (n) 

only, then the result of coupling between / and i n {M pq ) — L n (M pq ) is 0(l/n). 
Since is a compact subset of R°° x M°° , the same is true for any continuous test 
function F on 0, which completes the proof. □ 



By Lemma 6.4.1, 



so that the measures L n (Mpq^) must have the same limit as the measures i„(M^'). 
Together with Lemma 6.4.2 this completes the proof of Theorem 6.2.2. 

7. The commutant of representation T pq 

7.1. The results. Recall that if z is an integer, z = k E Z, then the representation 
T z = Tfc splits into a direct sum of subrepresentations called the blocks, 

Tk ~ @ T pq 

p—q—k 

where p, q are assumed to be nonnegative integers, and (p, q) ^ (0, 0) if k = (see 
§5.7). 

The main goal of this Section is to prove the following result. 

51 



Theorem 7.1.1. Let z = k be an integer and let T pq be an arbitrary block of the 
representation T k . Then the vector v pq £ H(T pq ) constructed in §6 is a cyclic vector 
ofT pq . 

Along with the Theorem 6.2.2 this implies our main result on representations T k 
at integer points z — k: 

Theorem 7.1.2. The block T pq C T z , where z — k is an integer and p — q = k, 
is equivalent to the direct integral of irreducible spherical representations labelled 
by the points u> of the finite dimensional face Q(p, q) of the Thoma simplex, with 
respect to Lebesgue measure du. 

Corollary 7.1.3. The representations T pq , where p,q e Z, are pairwise disjoint. 
In particular, the representations T k , k € Z ; are pairwise disjoint. 

7.2. The commutant A pq . Recall that the representation T pq is an inductive 
limit of finite dimensional representations of the groups G(n) in the spaces H n n 
H(T pq ) C Reg". Since 

K g ,60 = / Pq (A)^0 for\eY(p,q), 

the projection Vp£ of the vector v pq onto subspace H n n H(T pq ) is a cyclic vector, 
for every n. If one of the numbers p, q vanishes, we have Vpq = v pq and hence v pq is 
obviously a cyclic vector. But if vp^ ^ v pq , the fact that each vector Vpq is cyclic 
in the corresponding representation of the subgroup G(n) does not formally imply 
that the limiting vector is cyclic, too. See subsection 7.8. for a counterexample. 

In order to prove that the vector v pq is cyclic we study the commutant of T pq , 
making use of Proposition 5.3.1 and Theorem 5.5.1. We shall show that the matrix 
element (( • )v pq ,v pq ) provides a faithful state on the commutant, which implies the 
cyclicity immediately. Unfortunately, the proof turns out to be rather long. 

Fix a block T pq C T k , where k = p — q, and assume that p > 1, q > 1 (if one of 
the numbers p, q vanishes, the claim of the Theorem 7.1.1 is trivial). 

Set Y n (p, q) = Y n n Y(p, q); this is the nth level of the graph Y(p, q). It is not 
empty, starting with n = pq > 0. The graph Y(p, q) can be identified with the 
direct product of the graphs Y(p, 0) and Y(0, q). 

Denote by A pq the commutant of the representation T pq . According to Proposi- 
tion 5.3.1, there is a linear isomorphism A pq — > A pqj where A pq is the Banach space 
of complex-valued bounded functions ^4(A) on Y(p, q), satisfying the condition 

A(A) = ^p z (A,i/)A(i/), A6Y(p,«), 

with the norm 

||A||=su P |A(A)|. 

A 

According to Theorem 5.5.1, the function p z (X, v) has the form 

\z + cx, v \ 2 dim^ 



p z {\,v) = Pz (\,u) 



\z\ 2 + n (n+l)dimA' 



It will be important for us that p z (X, v) ^ for all couples A / v in the graph 
Y(p,q). 
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Denote by A pq the cone of nonnegative Hermitian operators in A pq . Its image 
with respect to the isomorphism A pq — ► A pq is contained in the cone A^ q C A pq 
generated by the functions A £ A pq with nonnegative values. One can show that 
the image actually coincides with A pq , but we do not need this fact. 

7.3. A faithful state on the algebra A pq . Denote by A m i n the rectangular 
diagram of size pxg; this is the only vertex of the graph Y(p, q) at the level pq. 

Lemma 7.3.1. The linear functional 

1] : in A(X min ), AeA pq 
provides a faithful trace on the algebra A pq . 

Proof. Clearly, the functional rj equals 1 at the function A(X) = 1 (which determines 
the identity of A pq ), has norm 1 and is nonnegative on the cone A pq . Hence, it 
defines a state on the algebra A pq . It remains to prove that this state is faithful. 
To do this we shall show that r)(A) > for every non-zero function A(X) in A pq . 
Define a "weight function" 9Jl pq (X) on the graph Y(p, q) by the recurrence relation 

\:\/v 

and the initial condition 

~^pq (-^min) 1- 

Denote by OJlpq the measure on Y n (p,q), n > pq, with the weights 9Jl pq (X) at 
the vertices A G Y n (p, q). Since p z (X, v) has the property 

all Tt p ^ are probability measures. 

By virtue of the main relation for the functions A( ■ ) <G A pq , the expression 

Vn (A) = (m$,A)= ]T M pq (X)A(X) 7 n>pq, 

\eY n (p,q) 

does not depend on n. Hence, it coincides with rj pq {A) = r/(A). 

Since p z (X, v) > 0, all the weights VJl pq (X) are strictly positive. Let now A( ■ ) be 
a non-zero function from A pq . Then there exists A € Y(p,q), such that A(X) > 0. 
If n = |A|, then (Wlpq , A) > 0, hence we conclude that n(A) = T] n (A) > 0. □ 

7.4. Evaluation of Tl pq . As in §6 above, we associate with a diagram A € Y(p, q) 
a couple of diagrams (A + , A~), and in order to simplify the notation we set dj = \f , 
b r = A^T for 1 < i < p, 1 < r < q. 
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Lemma 7.4.1. The "weight function" 9Jt pg (A) introduced in the proof of Lemma 
7.2.1 can be given by the explicit formula 



(n-pq + l) p 2 +q 2_ pq _ 1 
J] {at - dj + j - if II ( b r ~b s + s- r) 2 



l<i<j<p l<r<s<g 



Y\(ai + b r +p-i + q- r+l) 

i,r 

where n = |A| and 

(p 2 + q 2 -pq-iy.Yl t . r (p-i + <l-r + l) 
C(p,q) = , . 

(n>-*)! UAi-ry.) 

Proof. Recall that 9Jl pq (\) satisfies the recurrence relation 

V„ (p-<?) 2 +« (n + l)dimA pqK h 



where \v\ = n + 1 > pg. 
Set in this formula 



EI (p-g + c(6)) 



2 



„ , &eA\A min dim A ,,. 

P9 = (fr-^+n-l)! ~ ^ 9 

with a new unknown function 9Jlp g (A), n = |A|. Then for ffl pq {\) we get the 
recurrence relation 

Its solution has the form 

ffl pq (\) = const -Dim A, 

where Dim A stands for the number of paths, in the graph Y(p, q), going from A m ; n 
to A (the dimension function of the graph Y(p, q)). 

Since the graph Y(p, q) is isomorphic to the product of the graphs Y(p, 0) x Y(q, 0) 
(with the empty diagrams added to Y(p, 0) and to Y(0, q)), we get 

Dim A = 7YT7TiT^T7 dimA+ dimA ~- 
| A -1- 1 ! | A | ! 

It follows that 

II ( P -q + c(b)f 
6eA\A mi „ dim A dimA^ dim A 

OT - (A) = const ((p - g )2 + w -i)! "r^r (» - 

Substitute here the explicit expressions: 

n (*-»+*>> 2 =fn%^n (6 ' +5 ~ r)!V 



beA/A mi „ 
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(this is readily checked), 

Ft (°» - a j +3 ~i) II (W ~b s + s-r) 

dim A l<i<j<p l<r<s<q 

|A|! ~~ n i^+p-iy. I] (br + q-ry.YKai + br+p-i + q-r+l)' 

l<i<p l<r<q i,r 

(this can be derived from the hook formula in the same way as formula (2.7) in 
Olshanski [015]), and 

II {di-aj+j-i) II (b r -b s + s-r) 

dimA^ i<i<j<p dim A i<r<s<g 

~^+T = n (oi+p-iy. ' 1^V = n (K+q-ry 

l<i<p l<r<q 

(this is the well-known Frobenius formula, see, e.g., Macdonald [Mac, Ex. 1.7.6]). 
Then we get the desired expression, where the constant const can be found from 
the condition Wl pq (\ m i n ) = 1. □ 

7.5. The limit of the measures 9Jlpq . We shall need two technical lemmas. 
Lemma 7.5.1. For any e > there exists S > such that 

XGYn(p : q); a p +b q <8n 

for all n large enough. 

Proof will be given in §7.7. 
Lemma 7.5.2. The function 

n (ai-a,-) 2 n iPr-Ps? 

on the simplex Q,{p,q) is integrable with respect to Lebesgue measure du>. 
Proof will be given in §7.8. 

Consider now the embedding Z n : Y n (p,q) — > Q(p,q) introduced in §6.3. Let 
VRpq = Z n {^pq) be the push-forward of the probability measure Tlpq-, this is a 
probability measure on Q(p, q). 

Lemma 7.5.3. As n — > oo 7 the measures 9Jt p ^ on fl(p, q) weakly converge to a 
certain probability measure Mp^ . The measure OJtp^ is absolutely continuous 
with respect to Lebesgue measure duj on Q(p,q), and has the density 

n n iPr-Ps? 

, . l<i<j<p l<r<s<q 

C(p, q) 



i,r 

where the constant is the same as in Lemma 7.4-1- 
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Proof. Let A G Y n (p,q) and a;j3) — t„(A). It follows from the expression for 
Tlp q (X) in Lemma 7.4.1 that 

9Jl$(\)=C(p,q) n-^" 1 ) (l + 0(l/n))x 
II {on - a, + 0(l/n)) 2 n (/3 r -/? s +0(l/n)) 2 

l<*<i<J> l<r<s<q 

X n("i + /3r + 0(l/n)) ' 

i,r 

Given S > 0, we split the simplex Q(p, q) into the union of two subsets, 

fl(p, q) = n> s (p, q) U fl <S (p, q), 

determined by the conditions a p + (3 q > 5 and a p + (3 q < 6, respectively. On the set 
Q>s{p, q) the denominator of the expression for DJtpq(X) is bounded from below, 
uniformly in n. This implies the weak convergence of measures 



9Jlt ] 



— > 9Jt (oo) 

pq 



By Lemma 7.5.1, the total mass of the set fl < s(p, q) with respect to 9Jl$ can 
be made arbitrarily small (uniformly in n), provided that 6 is chosen sufficiently 
small, and n is large enough. By Lemma 7.5.2, the mass of the set fl^ip, q) with 
respect to 9)1$^ also tends to 0, together with <5. This implies that 9)1$ weakly 
converges to 901$^ on the entire simplex fl(p, q). □ 

Lemma 7.5.4. The state 

^ ^ {AVpq,Vp q ) 
( v pqj v pq) 

on the algebra A pq is faithful. 

Proof. We have to prove that if A e A pq , A^O, then (Av pq , v pq ) > 0. Set 

A{n) _ p Ap An) p 

If n — * oo, the operator P n AP n converges to A strongly, hence 

{Av pg ,v pg ) = lim (P n AP n v P q,Vpq) = lim (A^v$,v$). 
According to Proposition 5.3.1, 

AeY„(p,g) 

where A(A) is the function in A pq corresponding to the operator A. On the other 
hand, 

AGY„(p,g) 
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by definition of the vector v pq . Therefore, 

W>^)= E \.f Pq w\ 2 A(x)= y: ^w^Ittat- 

AeY„(p, 9 ) AeY„(p,g) p< ^ ' 

We have explicit expressions for both f pq (X) and 9Jt pq (X), see Theorem 6.2.1 and 
Lemma 7.4.1. These expressions imply that 



\f Pq (X)\ 2 
Tl pq (X) 

where 



Cpqn + b r + p - i + q - r + 1), 

_ (re - pq + 1) P 2 

(we have employed here an equivalent expression for f pq (X), see Lemma 6.3.3). 
Since 



we have 



1 

Cp<? " ~ C(p,q) nM' 



whence 

M = ( const +o(l)) J] fl - + b " +P ' 2 + g ' r + 1 

= const Y\_( a i + &) + o(l), 

where we assume that (a; (3) — T n (X). 

Let y\ p n q denote the measure on Y n (p, q) defined by 

K$(X)=A(\)m pq (X), XeY n (p,q). 

In the notation introduced in the proof of Lemma 7.3.1, 

A(X)m pq (X)=r ln (A). 

AGY„(p,g) 

We have noted there that rj n (A) docs not depend on n, and is strictly posi- 
tive. Therefore, the mass of the set Y n (p, q) with respect to the measure OT P g 
is strictly positive and does not depend on n. Consequently, passing to an appro- 
priate subsequence of indices ri\ < n>2 < . . . , we may conclude that the measures 

>(") T fTTt^h ^mmr™ „moH„ ^r, O I m „~\ o r-c-foir, „^„r, Q v« rvoocr-o <Y>(°°) 



yipq := Lni^pq ) converge weakly on f2(p, g) to a certain nonzero measure yi pq 

On th 
estimate 



On the other hand, for the weights of the measures m 1 ^ and 9J$q> there is an 



m p n q \X) = A(A)an&>(A) < ||A|| ot^(a), 
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hence 

n$<\\A\\wi£>. 

By Lemma 7.5.3, the measures converge weakly to a measure which 
is absolutely continuous with respect to the Lebesgue measure dto on the simplex 
Sl(p, q). It follows that 

m^<\\A\\m£\ 

which implies that Otp^ is absolutely continuous, too. 

Return now to the quantity (Av pq ,v pq ). We have shown that it can be repre- 
sented as a limit 



(Av pq ,v pq ) = lim {AWv£>,v£>) = Jdm const ( J](a, + (3 r ) + o(l)) V 

' i,r ' 

where const > 0. Hence, 

(Av pq , v pq ) = const Y[( ai + (3 r )). 



Since the measure 9tp^ is absolutely continuous and nonzero, and the function 
Y\(ai + f3 r ) on the simplex Vl{p 1 q) is continuous and positive almost everywhere, 
the result is a strictly positive number. □ 

7.6. The Cauchy determinant. We shall need a generalization of the classical 
Cauchy identity 



det 

where 



1 



x t + y 3 



m V(x)V(y) 

i,i=i Uufa + ViY 



v{x)= Yl ( x i- x j)> 

l<i<j<m 



to the case when the numbers of Xi's and yj's are not necessarily equal. 
Set 

x = Oi, . . . ,x p ), y = (yi, . . . ,y q ), 

and assume (to be definite) that p < q. We shall denote by the symbol y = y' U y" 
an arbitrary decomposition of the set of variables y = (j/i, . . . ,y q ) into disjoint 
subsets of cardinalities q — p and p respectively: 

y' = {y'i, ■ ■ ■ ,y' q - p ) = (vn, ■ ■ ■ ,y» 9 _ p ), y" = {y", ■■■ ,y p ) = fen, ■ ■ ■ ,yj p ), 

where 

h< ... < i q _ p , ji < . . . < j p , {h, . . . ,i q ^ p } U {ji, ... ,j p } = {l, ... ,q}. 

Set sgn(y', y") = ±1, where the sign plus/minus is taken depending on parity/imparity 
of the number of inversions in the permutation (ii, ... , i q - p ... , j p ) of the num- 
bers 1, . . . , q. 
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Lemma 7.6.5. The following formula generalizes the Cauchy determinant: 



V(x!, ... ,x p )V(y 1 , ... ,y q ) 



= ]T sgn^',/)^, ... ,y' q _ p )det 

y'Uy"=y 



Xi + y" 



Proof. One can easily derive this identity from the classical Cauchy identity by 
replacing the variables x\, ... , x p with x'{, ... , xp 1 , adding a new group of variables 

X^ , ... ; X „ , writing down the Cauchy identity in terms of the variables (sx[ , . . . , 

ex' q _ p ; x'{, . . . , x'p) and yi, ... , y q , and then applying the Laplace rule while e goes 
to 0. □ 

Another proof. The argument given below is similar to the well-known proof of the 
classical Cauchy identity. 

Denote the right-hand side of the identity in question by A(x,y). Then the 
product A(x, y)H(xi + yj) is a polynomial. It suffices to check the following three 
claims: 

(i) A(x, y) is skew symmetric, separately in x and in y. 

(ii) deg A(x,y) = deg V(x) + dcgV(y) - degll(a; i +yj). 

(ii) Let us order the variables as x\ > ■ ■ ■ > x p > yi > • • • > y q and consider the 
corresponding order on the monomials; then the leading term in the expansion of 
A(x, y)H(xi + yj) is the same as that for V(x) V(y). 

Now we have: 

(i) The skew symmetry with respect to x is evident. Let us show that A(x,y) 
changes the sign upon the elementary transposition yj «-> j/j+i, where j = 1, . . . , q— 
1. If the variables yj,yj + i enter the same group, y' or y" , then the corresponding 
term is already skew symmetric. Consider now the terms for which yj and yj + i 
belong to different groups. Those terms split into pairs: in each pair the terms are 
switched by the transposition yj <-> yj+i and the corresponding signs are opposite. 
Thus, the skew symmetry follows. 

(ii) This is trivial. 

(iii) It is readily verified that the leading monomial comes from the partition 

y' = (s/i, • ■ • ,y q - P ), y" = {y q - P +i, ■ ■ ■ ,y q )- □ 

7.7. Proof of Lemma 7.5.1. Without loss of generality we may assume that 
p < q. Set 

x t =at+p-i, l<i<p; Vj = bj +q- j, 1 < j < q. 

Taking into account the explicit formula for $H P9 (A) (Lemma 7.4.1) we have to 
prove the estimate 

V 2 (x)V 2 (y) 



J y V\x)V\y) 



summed over the integer vectors x € JF + , y € "L\ satisfying the conditions 
xi > . . . > x p > 0, yi > . . . > y q > 0, x p + y q <8n 

(7-6-1) 

xi + . . . + x p + yi + . . . + y q = n + const, 
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where "const" is an integer not depending on n. 

Apply the identity of Lemma 7.6.1. Since all variables are of order 0(n), we 
have 

V{x) V(y) V(y') = O (nh(p(p-i)+Q(<i-V+(<i-pK<i-p-i))^ = ^-pi+i 2 -^ . 

Using this and expanding the determinant in the right hand side of the identity in 
question, we reduce the problem to the following bound: 

^ ^ ¥1 + i)---(*p+f;'(p) + i) = 0(<5) ' 

where a splitting of variables y' Uy" = y is fixed, a is a fixed permutation of the 
indices 1, ... ,p, and summation is again taken under the conditions (7-6-1). 
There are three possibilities: 

(i) y" contains y q , and y'^ p) = y q , 

(ii) y" contains y q , but y" a(p) ^ y q , 

(iii) y" does not contain y q . 

The case (iii) reduces to that of (i), since replacing y"^ with y q < y"^ only 
increases the sum. 

The case (ii) can also be reduced to (i). Indeed, there exists i < p such that 
y'a(i) ~ Vi- We can now change a by switching y"^ and y"( p y This can be done 
by virtue of the inequality 

1 1 

< 



{A 1 +B 2 ){A 2 + B 1 ) (Ai + Bi){A 2 + B 2 ) ' 
(correct for A\ > A 2 > 0, B\ > B 2 > 0) which we apply to 

1 1 // 1 // 1 

Ai=Xi + -, A 2 =x p + -, B 1 =y a{p) + -, B 2 = y a(i) + -. 

Hence, we are left with the case (i), where y'^i p \ — y q - Let us relax the system of 
restrictions (7-6-1) by removing from it the inequalities x\ > . . . > x p , y\ > . . . > y q 
(but we still assume that all variables are nonnegative integers). This will result in 
a bigger amount of arrays x, y, hence the sum will increase, too. 

Set 

wi = x\ Wp-i = x p -! +y" {p _ 1) , w p = x p + y" (p) = x p + y p . 

Note that for every Wi there are precisely Wi + 1 ways to represent it as a sum of 
two nonnegative terms. Therefore, our bound reduces to the following one: the 
number of vectors (y[, . . . , y' q - pl w\, . . . ,w p ) G 7L\ such that 

y'i H h j/ q - p + »i H h w p = n + const, w p < 5n 



is of order 0(8)n q 1 . This bound is readily verified. 
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7.8. Proof of Lemma 7.5.2. We shall prove the analogous claim for the same 
density on the larger simplex Cl(p, q), obtained by removing the restrictions ct\ > 
■ ■ ■ > ot p , pi > . . . > (3 q . In other words, f2(p, q) is just the standard (p + q — 1) 
dimensional simplex. Without loss of generality we may assume that p < q. By the 
Cauchy type identity of Lemma 7.6.5 and taking into account the trivial bounds 
Q!i < 1, /3j < 1 we are reduced to the following claim: 

/dw 
(ai + Pi) . . . (a p + (3 p ) < °°' 

where dw is the Lebesgue measure on the standard (p + q — l)-dimensional simplex 
a i + S flj — 1) a i ^ 0: Pj > 0, the domain of integration. Project our simplex 
onto a (q — l)-dimensional simplex by applying the map 

(ai, ... ,a p ;Pi, ... ,P q ) i — > (ai + Pi, ... ,a p + /3 P ;0 P+1 , ... ,P q ). 

Under this projection, the push-forward of the measure with density 

1 

(ai +Pi)... (a p + p p ) 

is simply the Lebesgue measure (this is a particular case of a more general fact on 
the behavior of Dirichlet measures under projections of simplices) , which completes 
the proof of the lemma. 

This completes the proofs of Theorems 7.1.1, 7.1.2. 

7.9. Example of a noncyclic vector with cyclic projections. One can think 
that the proof of the cyclicity of the vectors v pq given above is a little bit too 
involved. Surely, one would try to simplify it. But the claim is not entirely trivial, 
and the goal of the present addendum is show that by an example. 

We shall provide a representation T = liin T n of a group G = lira G n , and a 
vector £ € H(T), such that, for each n, the projection £„ of the vector £ onto the 
subspacc H(T n ) is cyclic for T n , though the vector £ itself is not. 

Set G n —l^i so thtit G = Z2. The dual group to G n is again while 
the dual group to G is a compact group, G — Y[T ^2- With arbitrary finite Borel 
measure a on G one can associate a unitary representation T of the group G acting 
in the Hilbert space H = L 2 (G, a) by the formula 

(T(g)f)(x) = x(g)f(x), jeG, xeG, f e h. 

Denote by H n C H the subspace of functions f(x) depending on Xn '■= x\q only* 
and by T n the natural representation of the group G n in H n . The representation 
T coincides with lirn T„ . The space H n can be identified with L 2 (Z£, a^), where 
is the image of the measure a under the projection G — > (taking of the first 
n coordinates). If £ = /(•) € H, then the vector £„ e H n = L 2 (Z 2 l , cr^™)) can be 
obtained by integrating / along the fibers of the projection G — > . 

For p S (0, 1) denote by a p the Bernoulli measure on G — YIT ^2 = ni°{0) 1} 
with the weights p and 1 — p at the points and 1 respectively. By virtue of the 
law of large numbers, <r p is supported by the set X p C 111° {A 1} formed by 0-1 
sequences with the limiting frequency of 0's equal to p. 
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Take two distinct numbers p,p' € (0, 1) and set a = o~ p + ay. The measure a is 
supported by the union of two disjoint sets X p , X p > each of which has measure 1. 
Take for £ the characteristic function of the set X p . Clearly, £ is not cyclic, since its 
cyclic span is a proper subspace generated by the functions in I? (G, a) supported 
hyX p . 

On the other hand, the vector £„, as a function on Z?? , coincides with the Radon- 
Nikodym derivative a p n ^ / (<7 p n ^ + ) , hence is a strictly positive function. There- 
fore, £„ is a cyclic vector for T n for any n. 

8. DlSJOINTNESS 

8.1. The results. Our aim is to prove the following result 

Theorem 8.1.1. If z ranges over the upper half-plane 3z > 0, then the represen- 
tations T z are pairwise disjoint. 

The assumption 3z > is introduced because T z ~ T z . The definition of disjoint 
representations is given in §9... 

Let o z the spectral measure of the character Xz (§4-1). We shall deduce Theorem 
8.1.1 from the following result. 

Theorem 8.1.2. Assume z ranges over the set {z E C \ Z,^sz > 0}. 

(i) The measures a z are pairwise disjoint. 

(ii) Each of the faces il(p, q) C is a null set with respect to cr z . 

Derivation of Theorem 8.1.1 from Theorem 8.1.2. Let Z\, z 2 be two distinct com- 
plex numbers from the upper half-plane 3z > 0. We have to prove that T Zl and 
T Z2 are disjoint. Assume first that both z\ and z 2 are not integers. We know that 
if z € C \ Z then the distinguished spherical vector £o is a cyclic vector; hence the 
measure o z determines the representation T z entirely. According to claim (i) of 
Theorem 8.1.2, the measures cr z _i and er Z2 are disjoint; therefore the representa- 
tions T Z1 and T Z2 are disjoint, too. Assume now that Z\ e C \ Z while z 2 <= Z. 
According to Theorem 7.1.2, the representation T Z2 decomposes into a direct sum 
of representations labelled by the faces Q(p, q), p — q = z 2 . By virtue of claim 
(ii) of Theorem 8.1.2, T Zl and T Z2 are disjoint. Finally, when z\, z 2 are two dis- 
tinct integers, the disjointness of the representations was pointed out in Corollary 
7.1.3. □ 

Now we proceed to the proof of Theorem 8.1.2. 

8.2. Reduction to central measures. There is a one-to-one correspondence 
a <-» M between probability measures a on the Thoma simplex Q, and central 
probability measures M on the path space T, see §9... 

Lemma 8.2.1. Let g\ and a 2 be two probability measures on Q, and let M\ and 

M 2 be the corresponding central measures on T. Then <j\, a 2 are disjoint if and 
only if Mi and M 2 are disjoint. 

Proof. First, introduce a notation. Given two finite (not necessarily normalized) 
Borel measures v\, v 2 on a Borel space, let us denote by v\ A v 2 their greatest 
lower bound. Its existence can be verified as follows. Let fi and f 2 be the Radon- 
Nikodym derivatives of v\ and v 2 with respect to v\ + v 2 , then wc set z^i A v 2 = 
min(/i, f 2 )(vi + v 2 ). Observe that v\ and v 2 are disjoint if and only if v\ t\v 2 = 0. 
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Next, observe that the correspondence a <-» M can be extended to not necessarily 
normalized measures. 

Now we can proceed to the proof. In one direction the implication is trivial. 
Namely, if o\ and cr 2 are not disjoint, then o\ A <7 2 is a nonzero measure. Let M be 
the corresponding central measure. From the integral representation of Theorem 
9J.2 it follows that M < Mi and M < M 2 , so that MiAM 2 / 0, whence M and 
M 2 are not disjoint. 

In the opposite direction, assume that Mi and M 2 are not disjoint, so that 
Mi A M2 is nonzero. We claim that Mi A M 2 is a central measure. Indeed, this 
follows from the characterization of central measures as invariant measures with 
respect to a countable group action, as explained in Proposition 9.4.1. Now, let a 
be the measure on f2 corresponding to Mi A M 2 . It is a nonzero measure. Next, 
since MiAM 2 < Mi and MiAM 2 < M 2 , we also have a < 01, a < cr 2 . (Indeed, this 
claim can be restated as follows: if M, M' are two central probability measures such 
that M < const M' then the same inequality holds for the corresponding spectral 
measures on fi, and the latter claim can be checked by applying Theorem 9.7.3 or 
Theorem 9.7.4).) Therefore, a\ and cr 2 are not disjoint. □ 

8.3. Proof of claim (ii) of Theorem 8.1.2. Let p,q € Z + be not equal to 
simultaneously. Denote by T(p, q) the set 



T(p,q) = I 1 < * <p, j = l,2,...}u{(i,j)\l<j<q, i = l,2,...}, 



(a "fat hook") and by T(p, q) the set of paths r = (r„) G T such that r„ C T(p, q) 



Lemma 8.3.1. If a measure a is supported by q) C fi, then the corresponding 
central measure M is supported by T(p, q) C T. 

Proof. Let (AfW) be the coherent system corresponding to cr. We have (see §9...) 



where s\(u) is the supersymmetric Schur polynomial s\(a\, . . . , a p ; (3\, . . . , /3 9 ). It 
is known (Macdonald, [Mac, Example 1.5.23 (a)]) that this polynomial vanishes 
unless A belongs to T(p,q). Thus, for each n, vanishes outside T(p, q) n Y n . 

This is equivalent to the statement of the lemma. □ 

Lemma 8.3.2. Let z G C \ Z and p,(jeZ + be fixed. We assume that p + q > 
thus excluding the case p = q = 0. Let p z (X, v) be the coherent system M z . 

There exists e > depending on z, p, q only, with the following property. If 
A C T(p, q) is an arbitrary Young diagram such that the set v = \ U {(p + I, q + I)} 
is also a diagram, then 



for all n. 




Pz{\v) > e/n, 



n=\X\. 



Proof. Since the content of the box vj\ is q 



p, we have 




(n + 1) dim A 



dim v 



The first factor can be easily estimated from below: since z £ Z, there exists S\ > 
depending on z only, such that 

\z + q-p\ 2 > £l 
\z\ 2 + n ~ n 

Now consider the second factor. It follows from the hook formula, that 

dim v ~i r h(b) 

{n + l)dimA = 11 h(b) + 1' 

where the product is taken over the boxes b e A such that either the arm or the leg 
of b contains the box (p + 1, q + 1). There are exactly p + <7 such boxes 6, namely 

(p + i.j), i <j<<?; (*,g + i), i<i<P- 

Therefore, there is a product of p+q factors of the form kj (fc+1), where k = 1, 2, 

Each of the factors is greater or equal to 1/2, and the entire product is not less 
than 2~( p+q \ This provides the required estimate. □ 

Lemma 8.3.3. Let z e C\Z and let M z be the central measure on T corresponding 
to the measure a z . We have M z (T(p, q)) = for all p, q. 

Proof. Denote by T'(p, q) the set of those paths t e T(p, q) that are not contained 
the smaller sets T(p — 1, q) and T(p, q — 1). It suffices to prove that T'(p, q) has 
measure with respect to M z . 

Let /j, be an arbitrary diagram in T(p, q) that contains those two boxes, set 
m = \fj,\, and denote by T(p,q;fi) the set of paths r e T(p,q) with r m = /U. For 
any path r = (t„) G T'{p,q) there exists a number n such that the diagram r n 
contains the boxes (p + 1,<?) and (p, g + 1). Consequently the set T'(p,q) is the 
countable sum of the sets of the form T(p, Thus, it remains to prove that 

each set T(p, g; /x) has measure 0. 

It will be convenient to look at the measure M z as describing a Markov process 
with the transition function p z (A, v) . Set 

p„ = Prob{r„+i /iCt„C T(p, g)}. 

The measure of the set T(p, q; /z) coincides with the probability of the event r m = /i, 
multiplied by the product of the conditional probabilities [] )J>m p m . 
By Lemma 8.3.2, we have 

e 

Pn < 1 

n 

so that n„> m P„ = 0. □ 

Proof of claim (ii) of Theorem 8.1.2. Let a be the restriction of the measure a z to 
Q(p,q), and let us show that a = 0. Let M be the central measure corresponding 
to a. According to Lemma 8.2.1, M is supported by T(p,q). On the other hand, 
it follows from Lemma 8.3.3 that T(p,q) is a null set for M z . Since M < M z , we 
conclude that M = 0, hence a = 0. □ 
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8.4. Proof of claim (i) of Theorem 8.1.2. Recall that if z G C \ Z, then the 
measure M z n ^ has nonzero weights Mi™' (A) for all A e Y„, and we have an explicit 
formula for M { z n) (X), see Theorem 4.1.1. 

Fix two distinct numbers z\, z 2 in the upper half-plane ^sz > 0, which are not 
integers. We have to prove that the spectral measures o~ Zl and o~ Z2 are disjoint. By 
virtue of Lemma 8.2.1, it suffices to prove that the corresponding central measures 
M Zl and M Z2 are disjoint. To simplify the notation, we set Mi = M Zl , M 2 = M Z2 . 
We also denote by (M^) and (M^) the corresponding coherent systems. 

Introduce a sequence ^«(t) of functions on T, 



<Pn(r) = 



M[ n \r n )' 



n = l,2, 



T = (T„) G T. 



Let X be the set of paths t e T such that the sequence (<£ n (r)) n >i converges, as 
n — > oo, to a finite nonzero limit. This is a Borel subset of T. 

Lemma 8.4.1. VFe Ziawe Ml(X) = M 2 (X) = 0. 

Proof. We shall show that X is contained in the union of the sets T(p, q), so that 
the claim will follow from Lemma 8.3.3. 

Denote by Ck{r) the content of the fcth box r k \ Tk-i- By virtue of the explicit 
formula for (Theorem 4.1.1), we get 



fc=l 



z 2 + Cfc(r) 



z\ + Cfc(r) 



+ k-l 



\z 2 \ 2 +k- 1 



Therefore, X consists of those paths t for which the infinite product 



fe=i 



^2 + Cfe(r) 



+ Cfc(r) 



1 



z 2 \ 2 + k- 1 



converges. In particular, the fcth factor in the product should go to 1. Since the 
second fraction in right-hand side converges to 1, as k — > oo, we conclude that 

2 

= 1, T£l 



lim 

k— >oo 



22 +c k (r) 



z\ + Cfe(r) 



It follows from our assumptions on Z\, z 2 that the equality |z 2 + c | 2 = l-^i + c | 2 
may hold for at most one real number c. Indeed, this equation on c describes the 
set of points c that are equidistant from —z\ and — z 2 . Since Z\ ^ z 2l this set is a 
line in the complex plane C, which cannot coincide with the real axis K, because 
z\, z 2 are both in the upper half-plane. Thus, the line is either parallel to R (then 
there is no real c at all) or intersects R at a single point. 

Now, we fix an arbitrary integer c such that 

2 

^1- 



z 2 



z\ 



For any r € X, the existence of the limit above implies that there is only a finite 
number of integers k such that Cfe(r) = c. This means that any path r e X may 
contain only a finite number of boxes (p, q>) on the diagonal q — p = c. Therefore, 
t is contained in some subset of type T(p, q), which concludes the proof. □ 
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Lemma 8.4.2. Let A and B be two central probability measures on T and (A^), 
be the corresponding coherent systems. Assume A < const B and let /(r) 
denote the Radon-Nikodym derivative of A with respect to B. Assume further that 
B (n *>(\) ^ for all n and all X G Y„. Then 

lim ^yp{ = M 
for almost all paths r = (r„) G T with respect to B . 

Proof. Let denote the set of finite paths in Y going from to a vertex in 
Y„. There is a natural projection T — > 7~["1 assigning to a path r its finite part 
T H = (ro, ... , t„). Notice that the infinite path space T can be identified with the 
projective limit space hm . 

Denote by El™l the finite algebra of cylinder subsets with the bases in T^ n h The 
algebras E^ form an increasing family, and the union E = (J coincides with 
the algebra of all Borel sets with respect to the topology of T. 

Consider the probability space (T, T,,B). The function / is bounded and im- 
measurable. Hence, by the martingale theorem (cf., e.g., Shiryaev [Shir, Ch. VII, 
Section 4, Theorem 3] 

lim E(/ | EW) = /. 

n^oo 

almost everywhere. 

On the other hand, let A^ and B^ be the push-forwards of the measures A 
and B taken with respect to the projection T — > T^l. The conditional expectation 
E(/ | E [ ™]) is nothing but the function 

fn(r)- 



Since A is a central measure, we have 



and similarly 



It follows 



AM(tM) = — 4< n >(r n ), 
dimr,, 



dim r„ 



BW(r»)' 
and the proof is completed. □ 

Proof of claim (i) of Theorem 8.1.2. We have to show that the measures Mi and 
M 2 are disjoint. Set A = Mi, B = (Mi + M 2 )/2. Then A < 2B and hence there 
exists the Radon-Nikodym derivative of A with respect to B. Denote it by /(r). 
We have < /(r) < 2. The measures Mi and M 2 are disjoint if and only if /(r) 
takes only two values and 1, almost surely with respect to the measure B. 
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On the other hand, by virtue of Lemma 8.4.2 above, f(r) is l?-almost surely the 
limit of the functions / n (r). Let Y be the set of those paths r for which the limit 
of / n (r) exists and is distinct from and 2. Observe that 

Jn\T) — D /„w_ v — -i" 



SW(r n ) M («) (Tn) + M («) (Tn) 



in the notation introduced before Lemma 8.4.1. Consequently, Y coincides with 
the set of those paths r for which ^„(t) has a finite nonzero limit, that is, Y = X. 
But Mi{X) = M 2 {X) = by virtue of Lemma 8.4.1. Hence, B(Y) = B(X) = 0, 
so that /(r) is or 2 almost surely with respect to B. □ 

The proof of Theorem 8.1.2 is completed. 

9. Appendix 

9.1. Young diagrams and representations of finite symmetric groups. We 

identify partitions with Young diagrams, and denote by Y n the set of Young dia- 
grams with n boxes. Given a Young diagram A, we denote by |A| the number of its 
boxes, and by A' the transposed diagram. 

Recall that Y„ is a natural set of labels for irreducible representations of the 
finite symmetric group S(n). Given A e Y„, we denote by ir x the corresponding 
irreducible representation of S(n) and by \ X its character. Let 

dim A = dini7r A = x A ( e )- 

The quantity dim A is called the dimension of A. There are several explicit 
formulas for the dimension. For example, the hook formula says 

dim A = — , Ahn. 

UbexHb) 

Here the symbol b e A means that b is a box of A, and if are its coordinates 
than h(b), the hook length of b, is defined by 

h{b) = X i + X' j -i-j + l. 

Given two Young diagrams A and jj,, we write \x / A if \i C A and |A| = + 1, 
that is, A is obtained from \x by adding a box. 

The classical Young branching rule says that for any A e Y„ 

This implies 

X \s(n-i) = E x>1 ' 
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9.2. The Young graph and cotransition probabilities. Let Y be the set of 

all Young diagrams: the disjoint union of the sets Y„, where n = 0, 1, . . . (we agree 
that Y consists of a single element, the empty diagram 0). We view Y as the set 
of vertices of a graph, called the Young graph and denoted also by Y. By definition, 
the edges of the Young graph are arbitrary couples fi / A. The Young graph is a 
convenient way to encode the Young branching rule. 
For jU e Y„_i and A e Y„ set 



q{n, A) 



dim /j,/ dim A, if \i / A 
0, otherwise. 



By convention, q(0, A) = 1 for the single element A e Yi (the one-box diagram). 
By the Young branching rule, 

^ dim /j, = dim A, 

>«eY„_i:/j/A 

so that 

E ?0M) = i. 

|ueY n _i,A 

The numbers q(fj,,X) are called the cotransition probabilities (see Kerov [Ker2], 
[Ker4]). They constitute a probability distribution for any fixed A — the cotransi- 
tion distribution. 

9.3. Coherent systems of distributions on the Young graph. Let A„ be 

the set of probability distributions on the finite set Y„. This is a finite-dimensional 
simplex whose vertices are Dirac measures S\ with A e Y„. 
For any n = 1,2,..., define an affine map A„ — ► A„_i by 

Let 

A = hjnA„ 

be the projective limit of the simplices taken with respect to these maps. 

By the very definition, an clement of A is a sequence M = {M^"^}„ =0; i i ... such 
that Af(") is a probability distribution on Y„ and any two measures M^™" 1 ^, 
with consecutive indices fulfill the coherency relation 

= E 9(M,A)M(")(A), V/iG Y n _L 
Ae¥„ 

Elements M G A will be called coherent systems of distributions. 

Alternatively, we may regard any M € A as a real function on Y such that 

• First, M (A) > for any A e Y. 

• Second, for any n = 1, 2, . . . and any /i e Y n _x 



M(/x)= E 5(M,A)M(A). 
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• Third, M(0) = 1. 

Indeed, the only point to be checked is that if M satisfies the above conditions 
then its restriction = M \y n is a probability distribution on Y„, that is, 

M^ n \\) = 1. But this is readily proved by induction on n. 
A function /(A) on Y is called harmonic if it satisfies the relation 

/(A) = /(") VA e Y - 

The coherency relation for a function M(A) is equivalent to the harmonicity relation 
for the function /(A) = M(A)/dimA. 

For further details, see Vershik-Kerov [VK2], Kerov [Ker2], [Ker4]. 

9.4. Central measures on paths and transition probabilities. By a path in 
the Young graph we mean a sequence of vertices 

t = (t„ / r n +i /■■■), n e Y i; 

which may be finite or infinite. Let T be the set of all infinite paths starting at 0. 
This is a subset of the infinite product set JI^Lo We en dow T with the induced 
topology. Then it becomes a compact totally disconnected topological space. Given 
a probability measure on the path space T, we may speak about random paths. 

To any coherent system M on Y we assign a probability measure M on T with 
cylinder probabilities defined as follows. Let A € Y„ be an arbitrary vertex and r be 
an arbitrary finite path going from to A, then the probability that the M-random 
path goes along r (up to A) equals M(A)/ dim A. 

The measure M is central in the sense that the cylinder probabilities depend 
only on the final vertices A but not on the paths t„ chosen. Conversely, any central 
probability measure on the path space comes from a (unique) coherent system. 

There is a useful characterizations of central measures as invariant measures 
with respect to a countable group of transformations of T. This group is defined as 
follows. First, for each n we let G(ri) be the group of the transformations g : T — > T 
such that for any path r = (r„) G T, we have r m — (g{r)) m for all m> n. Clearly, 
this is a finite group and we have Q{n) C Q(n + 1). Next, we define the group Q as 
the union of the groups Q(n). 

Proposition 9.4.1. A measure on T is central if and only if it is invariant under 
the action of Q. 

Define the support of a coherent system M as the subset 

supp(M) = {A e Y : M (A) ^ 0} C Y. 

The measure M is concentrated on the subspace of paths entirely contained in 
supp(M). We may view M as a Markov chain on the state set supp(M), with the 
transition probabilities 

p(X, v) = Prob{r n+ i = v \ r n = A}, A e Y„, v e Y n+ i, 

where t = (r„) is the random path. The transition probabilities p(A, v) are unam- 
biguously defined for all A e supp(M) by 

, MM dim A ,,,, 
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The system of transition probabilities uniquely determines the initial central 
measure, so that distinct central measures have distinct transition probabilities. On 
the other hand, all central measures have one and the same system of cotransition 
probabilities, which are nothing but the quantities q{^, A) introduced in §9.2. That 
is, we have 

q(p, A) = Prob{r„_i = \i \ t„ = A}, /i G Y„_i, A e Y n . 

For further details, see Vershik Kcrov [VK2], Kcrov [Ker2], [Ker4]. 

9.5. Characters of the group 5(oo). Recall that we have defined the infinite 
symmetric group S(oo) as the inductive limit of the finite symmetric group S(n) 
as n — > oo. A function \ '■ S(oo) — > C will be called a character if it is central (i.e. 
constant on conjugacy classes), positive definite, and normalized at the unity (i.e. 
x(e) = 1). The set of all characters of S(oo) will be denoted by X. 

Proposition 9.5.1. There is a natural bijective correspondence 

X 3 x <-> M e A 

between characters of S(oo) and coherent systems of probability measures on the 
Young graph. 

Proof. Let \ £ X. For any n, set Xn — x\s(n)- This is a central, positive definite, 
normalized function on S(n). As readily verified, such functions are exactly the 
convex combinations of normalized irreducible characters x A /dimA. Thus, 



MW(A) 



AeY„ 



x x 

dim A 



n • 



with certain nonnegative coefficients M^ n \\), 

AfW(A) = 1. 

AeY„ 

These coefficients may be viewed as the Fourier coefficients of the function x 
They form a probability distribution on Y„; denote it by M^ n \ Let us check that 
the distributions obey the coherency relation. Indeed, by virtue of the Young 
branching rule, this is simply equivalent to saying that the function Xn—i coincides 
with the restriction of \n to S(n — 1). Thus, starting from a character \ we obtain 
a coherent system M — {M (n ^}. 

Conversely, let M be a coherent system. Then, for any n, we may define a 
function Xn on S(n) as above. These functions are pairwise compatible and hence 
define a function \ on the group 5(oo). It is readily verified that x is a character. □ 

Both X and A are certain sets of functions (on 5(oo) and Y, respectively). These 
sets are convex, and the bijection X <-» A is an isomorphism of convex sets. 

Further, both X and A are compact topological spaces with respect to the topol- 
ogy of pointwise convergence, and our bijection is a homeomorphism with respect 
to this topology. 
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9.6. Thoma's theorem. Let Ex X denote the set of extreme points of the convex 
set X. Elements of Ex A" will be called extremal characters of the group S(oo). 

The first examples of extremal characters are as follows. Let f2(p, q) C M p x R 9 
be the set of couples (a, (3), where a — (a\ > ■ ■ ■ > a p > 0) and (3 = (/3i > • • • > 
fi q > 0) be two collections of numbers such that 

p <? 

i=i j=i 

Here one of the numbers p, q may be zero (then the corresponding collection a or 
(3 disappears). 

For (a, (3) e Q(p, q) and k = 1, 2, . . . , set 

i=i i=i 

Notice that 

Pi(a,/3) = 1. 

Given s e S'(oo), we denote by mk{s) the number of fc-cycles in s. Since s is a 
finite permutation, we have 

rni(s) = oo, rrik(s) < oo for fc > 2, mfc(s) = for fc large enough. 

In this notation, we define a function on 5(oo) by 

oo oo 
fe=l fe=2 

where we agree that 1°° = 1 and 0° = 1. Any such function turns out to be an 
extremal character: this claim is a particular case of a more general result stated 
below. 

If p = 1 and q — (i.e., a\ — 1 and all other parameters disappear) then we get 
the trivial character, which equals 1 identically. If p = and q = 1 then we get the 
alternate character sgn(s) = ±1, where the plus-minus sign is chosen according to 
the parity of the permutation. More generally, we have 

X K«. sgn = x (/3,a). 

Let M°° denote the direct product of countably many copies of R. We equip R°° 
with the product topology. Let O be the subset of R°° x R°° formed by couples 

a e R°°, f3 e M°° such that 

OO oo 

<* = (<*1 ><*2> ■■■><)), /?=(/?!> ft >■■■>()), j^Oi + j^ < 1. 

i=l j=l 

We call the Thoma simplex. As affine coordinates of the simplex one can take 
the numbers 



at - a 2 , • • • , - a p , a p , 0i - (h, (3 g -i - (3 q , (3 q 
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but we will not use these coordinates. We equip S} with topology induced from that 
of the space R°° x R°° . It is readily seen that O is a compact space. Clearly, each 
set S}(p, q) may be viewed as a subset of SI, (this is one of finite-dimensional faces 
offi). 

Notice that the union of the simplices Q(p, q) is dense in SI. For instance, the 
point (0,0) = (a = 0, (3 = 0) £ SI can be approximated by points of the simplices 
SI p q as p — > oo , 

(Q,0) = lim((l/p,...,l/p),0). 

p^OO V v / 

P 

Now we extend by continuity the definition of the functions x^ a '^ given above. 
First, for any k = 2, 3, . . . we define the function p k on SI as follows. If ui = (a, (3) £ 
SI then 

PfcM = p fc (a, /?) = f; a? + (-l) fe - x £ 
»=i i=i 

Note that is a continuous function on f2. It should be emphasized that the 
condition k > 2 is necessary here: the similar expression with k = 1 (that is, the 
sum of all coordinates) is not continuous. 
Next, for any ui = (a, f3) £ SI we set 

oo 

X M (s) =X {aS \s) = Y[(p k (a,p)r*^, s £ S(oo), 

k=2 

Theorem 9.6.1 (Thoma's theorem). The functions \^ are precisely the ex- 
tremal characters of the group S(oo). 

That is, for any u> G S} the function \^ 1S an extremal character, each ex- 
tremal character is obtained in this way and different points uj £ SI define different 
characters. 

In particular, the character x^~'~^ is the delta function at e £ S(oo). It corre- 
sponds to the biregular representation defined in §1.3. 

Notice that the set X carries a natural topology - that of pointwise convergence 
on the group. Endow the subset Ex A" C X with the induced topology. Then the 
correspondence Ex X <-> SI given by Thoma's theorem becomes a homeomorphism 
of topological spaces. 

This implies, in particular, that characters \^ with parameters to £ U p>q Q(p, q) 
are dense in the whole set ExX with respect to the topology of pointwise conver- 
gence on the group 5(oo). 

Comments to Thoma's theorem. 1. The original proof of Thoma was given in his 
paper [Thol] published in 1964. Thoma first proved (Satz 1 in [Thol]) that a 
character \ is extremal if and only if it is a multiplicative class function, that is, 

oo 

xM = IK ifc(s \ seSM, 

fe=2 

with certain real numbers P2,P3, This reduced the problem to the following 

one: find all sequences (p2,P3, ■ ■ •) such that the expression above is a positive 
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definite function on the group 5(00). An equivalent condition on (p 2 ,P3, ■ ■ ■ ) is as 
follows: let hi, h 2 , ■ ■ ■ be defined by 



00 

1 + h\U + h 2 u 2 + h 3 u 3 H = exp (u + ^^Pk-j^j 

k=2 

and set h n = 1, = /i_ 2 = • • • = 0; then 

det [hxi-i+j] > for any A e Y. 

l<i,j<£(\) 

Then Thoma succeeded to prove that the sequences (hi — 1, h 2 , h 3 , . . . ) with 
this property are exactly those given by the formula 

1 + h lU + h 2 u 2 + h 3 u 3 h — = e 7 " TT i±^H , 

where 

00 

{a, (3) eft, 7 = l-^(ai+A), 

i=l 

which implies the theorem. Actually, this result is equivalent to Edrei's classification 
(1952) of one-sided, totally positive sequences in the sense of Schoenberg, see Edrei 
[Edr]. Since the paper [Thol] contains no reference to Schoenberg or Edrei, one 
may conclude that Thoma was unaware of their work. 

2. Quite a different proof of Thoma's theorem was given by Vershik and Kerov 
([VK1], [VK2], 1981). Instead of function-theoretic arguments of Edrei and Thoma, 
Vershik and Kerov used an asymptotic method (whose general idea was suggested by 
Vcrshik's paper [Ver]): approximation of extremal characters of 5(00) by irreducible 
normalized characters \ X I dim A of finite groups S(n), as n — > 00. The asymptotic 
method explains the origin of Thoma's parameters ai,Pi\ they arise as limits of 
normalized Frobenius coordinates of the growing diagram A. 

3. An important combinatorial lemma, stated in [VK2] without proof (see [VK2, 
§5, Lemma 1]), was proved in Kerov-Olshanski [KO]. A particular case of it (which 
is sufficient for completing the proof of Thoma's theorem) was proved in Wasser- 
mann's thesis ([Was]). For more detail, see also Okounkov-Olshanski [OkOl, §8], 
Olshanski-Regev-Vershik [ORV]. 

4. Okounkov's work [Okl, Ok2] provides one more approach to Thoma's theo- 
rem. In particular, Okounkov showed that a crucial step in Thoma's proof can be 
replaced by a simple representation-theoretic argument. 

5. Finally, the paper Kerov-Okounkov-Olshanski [KOO] contains a far general- 
ization of Thoma's theorem obtained by the asymptotic method of [VK2] . 

9.7. Spectral decomposition of characters. 

Theorem 9.7.1. (i) For any character \ € X, there exists a probability measure 
a on the Thoma simplex VL such that 

Jn 
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(ii) Such a measure is unique. 

(iii) Conversely, for any probability measure a on Vl, the function x defined by 
the above formula is a character of S(oo). 

Thus, X is isomorphic, as a convex set, to the set of all probability measures on 
the compact space O. 

We call this integral representation the spectral decomposition of a character. 
The measure a will be called the spectral measure of x- If X is extremal, i.e., 
X = X^\ then its spectral measure reduces to the Dirac mass at to. 

Theorem 9.7.1 admits an equivalent formulation in terms of coherent systems. 
To state it we need to extend the above definition of the functions Pfe(w) to ar- 
bitrary symmetric functions. Let A be the algebra of symmetric functions (see 
Macdonald [Mac]). The power-sums pk are algebraically independent generators 
of A, so that the assignment pk i— > Pk can be extended to a homomorphism of the 
algebra A into the algebra C(f2) of continuous functions on the Thoma simplex 
f2. Given / G A, we denote by / its image in C(O). In particular, we apply this 
to the Schur functions s\: the corresponding functions s\(w) are called the ex- 
tended Schur functions (see Vershik-Kerov [VK3, §6], Kerov-Okounkov-Olshanski 
[KOO, Appendix]). Notice that the restriction of s\ to Cl(p,q) C O is nothing but 
the supersymmetric Schur polynomial s\(a\, . . . , a p ; [3\, . . . ,(3 q )) (see, e.g., Berele- 
Regev [BR], Macdonald [Mac, Example 1.3.23]; in Macdonald's notation, this is 
s\ (ax,..., a p ;-/3i,..., -/?,)). 

Theorem 9.7.2. Let x be a character of S(oo), M = (M<"') be the corresponding 
coherent system, and a be the spectral measure of x- For any n = 0, 1, 2, . . . and 
any A e Y„ we have 



In particular, the coherent system corresponding to an extremal character x^ 
has the form Af( n >(A) = dim A • s x (uj). 

For a proof of Theorem 9.7.2, see Kerov-Okounkov-Olshanski [KOO] (that paper 
actually contained a more general result). 

The claim of the theorem is similar to the Poisson integral representation of 
harmonic functions (see Kerov [Ker2], [Ker4], Kerov-Okounkov-Olshanski [KOO]). 
Notice that the role of the Poisson kernel is played here by the function (X,u) 
s\(w). 

Theorems 9.7.1 and 9.7.2 involve the claim that a certain convex set (that of 
characters or coherent systems, or yet equivalently, that of central measures) is 
a Choquet simplex. That is, each point of the convex set in question is uniquely 
representable by a probability measure on the subset of extreme points. This fact 
does not rely on the specific nature of the group S(oo) or the Young graph, and can 
be derived from some very general theorems. See, e.g., Diaconis-Freedman [DS, 
section 4], Olshanski [017, §9]. 

The next result can be viewed as a kind of Fatou's theorem on boundary values 
of harmonic functions. To state it we need to introduce some important notation 
and definitions. 
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Recall the definition of the Frobenius coordinates of a nonempty diagram A G Y: 
these are the integers p\ > ■ ■ ■ > pd > 0, q\ > ■ ■ ■ > qd > 0, where d is the number 
of boxes on the main diagonal of A and 

Pi =Xi-i, q i = X' i -i, i = l,...,d. 

Any collection of integers pi > ■ ■ ■ > pd > 0, q\ > ■ ■ ■ > qd > corresponds to a 
Young diagram. The transposition A ^ A' corresponds to interchanging pi <-> g^. 

We also need the so called modified Frobenius coordinates of a diagram A, which 
are defined by 

Pi=Pi + \, q~i=qi + \, i = l,...,d. 
It is convenient to agree that 

Pi = qi=0, i> d. 

Notice that 

oo 
i=l 

For each n we define an embedding t n : Y„ — > 51 by 

t„(A) = (a,/3), a, = — , ft = — , i = l,2, A e Y„. 

n n 

Notice that the union of the finite sets t„(Y„) is dense in f7. 

Theorem 9.7.3. Let \ be a character of S(oo), a be its spectral measure, and 
M = (M( n )) be the coherent system of distributions corresponding to \- Further, 
let L n (M^) be the push-forward of the measure under the embedding i n : 

Y„ -» fl. 

As n ^ oo, the measures i n (M^) converge to a in the weak topology of measures 
on the compact space 0. 

For a proof, see Kerov-Okounkov-Olshanski [KOO]. 

Finally, we shall state a related result concerning central measures. An infinite 
path t = (t„) £ T is called regular if the points t„(r„) e il converge to a limit as 
n — > oo; then the limit point is called the end of the path. Let T be the set of 
regular paths; this is a Borel subset of T. Assigning to a regular path its end we 
get a Borel map T' —* Q. 

Theorem 9.7.4. Any central probability measure M is supported by T . The push- 
forward of M under the map T' — > Q coincides with the spectral measure a of the 
character \ <-> M . 

The proof is similar to (and actually simpler than) the proof of Theorem 10.2 in 
Olshanski [01sh7]. 

9.8. Spherical representations and spherical functions. Let G be the bisym- 
metric group 5(oo) x 5(oo) and K be the diagonal subgroup in G, canonically 
isomorphic to S*(oo). 

Assume we are given a unitary representation T of the group G in a Hilbert space 
H. A vector £ <E H is said to be a cyclic vector if the linear span of the vectors 
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T(g)£, where g ranges over G, is dense in 7i. Suppose that £ is cyclic, invariant 
under the action of the subgroup K, and ||£|| = 1. In such a case we say that the 
couple (T, £) is a spherical representation. We will call £ the spherical vector. 

Denote by $ the set of all functions on G that are positive definite, K—bi— 
invariant, and normalized at the unity. If (T, £) is a spherical representation of 
(G,K), then the matrix coefficient corresponding to the spherical vector, 

<p(g) = (T(g)t,t), geG, 

is an element of $. We call ip the spherical function of (T, £). The couple (T, £) 
is uniquely (up to a natural equivalence) reconstructed from its spherical function, 
by use of the Gelfand-Naimark construction. Moreover, any ip e $ comes from a 
certain (T, £) . Thus, there is a one-to-one correspondence between functions ip € $ 
and (equivalence classes of) spherical representations (T, £). 

Assume T is an irreducible unitary representation of G. Then the space of its 
if-invariant vectors has dimension or 1 (indeed, this follows from the fact that 
(G,K) is a Gelfand pair, see Olshanski [013, §1]). Thus, if T possesses a nonzero 
if-invariant vector £ then £ is unique, within a scalar multiple. Observe that £ is 
automatically cyclic, because any nonzero vector in an irreducible representation is 
cyclic. Thus, assuming ||£|j = 1, we see that (T, £) is a spherical representation. The 
only lack of uniqueness in the choice of £ is reduced to multiplying £ by a complex 
scalar of absolute value 1, which does not affect the spherical function <p(g) = 
(T(<7)£,£). Notice that ip is an extreme point of the convex set $. Conversely, if 
p G $ is extreme then the corresponding spherical representation is irreducible. 

Proposition 9.8.1. There is a natural bijective correspondence \ <-» ip between 
characters \ G X and spherical functions 

Proof. Indeed, the relation between \ an d <P has the form 

f '(9i,92) = Xidig^ 1 ), X(s) = V{s, e), 

where 32, s are elements of S(oo). Clearly, the normalization %(e) = 1 is equiva- 
lent to the normalization ip(e) = 1. It is readily verified that \ 1S constant on conju- 
gacy classes if and only if is constant on double cosets. Next, let {gi} = {(gu,gi2)} 
be a finite collection of element of the group G, and let Sj = g%\g^£ be the cor- 
responding elements in S (00). Remark that gj 1 gi lies in the same double coset 
modulo K as (s~ 1 s i ,e). It follows that <p{g~ 1 gi) = x(sJ 1 Si), so that <p is posi- 
tive definite if and only if \ i s - Thus, \ f i s indeed a bijective correspondence 
between the two sets. □ 

Clearly, the bijection \ ¥ 1S an isomorphism of convex set. Therefore, irre- 
ducible spherical representations of (G, K) are parametrized by extremal characters, 
and finally by points lo € f2. 

More generally, combining Proposition 9.8.1 with the description of characters 
given in Theorem 9.7.1 we obtain a general description of spherical representations 
(T, £). Specifically, any such (T, £) is determined by a probability measure a on f2. It 
is worth noting that, as long we are dealing with reducible spherical representations, 
a given T may well possess a lot of if-invariant cyclic vectors. If £ is replaced by 
another spherical vector £' then a is replaced by an equivalent probability measure 
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a'. Thus, the equivalence class of T is determined by the equivalence class of a. 
This equivalence class of measures on f2 will be called the spectral type ofT. 

Using the abstract machinery of direct integrals of Hilbcrt spaces one can show 
that any spherical representation (T, £) can be decomposed into a multiplicity free 
direct integral of irreducible spherical representations (T^, £"). This decomposi- 
tion, which may be called the spectral decomposition of (T 1 , £), is unique, and it is 
governed by the spectral measure a: 

T= f T^a(du), £= f ^ ] o-{dLo). 

J u J uj 

Assume (T",£') is another spherical representation and a' is the corresponding 
spectral measure. The measures a and a' are said to be disjoint if they are singular 
with respect to each other (then there exist two disjoint Borel sets supporting them). 
The representations T and T" are said to be disjoint if they have no equivalent 
nonzero subrepresentations. Disjointness of a and a' is equivalent to disjointness 
of T and T. 

9.9. Admissible representations. Spherical representations enter a wider class 
of representations that will be defined now. 

For m < n, let S m {n) C S(n) denote the subgroup fixing the points 1,2, ... , m. 
Set 

5 m (oo) = |J S m (n) C S(oo) 

n>m 

and denote by K m C K the corresponding subgroup of K = 5(oo). Recall that 
by G(m) we denote the subgroup S{m) x S(m) in the bi-symmetric group G. An 
important fact is that the subgroups K m and G{m) commute to each other. 

Given a unitary representation T of the group G in a Hilbert space H, let TC m = 
H Km be the subspace of if m -invariant vectors, and set 

Woo = [J 7~t m . 

m 

We remark that Ti-ao is a G-invariant (algebraic) subspace in 7i. Indeed, for any 
m, T-L m is invariant under G(m), because G(m) and K m commute. Since G is the 
union of G(m)'s, it follows that Hoo is invariant under G. Thus, the closure of Ti^ 
is an invariant subspace of the representation T. 

We say that T is an admissible representation of the pair (G, K) if the subspace 
TLoa as defined above is dense in H. 

For more detail about this definition, sec [013] and also [012], [014]. Not all 
representations of G are admissible, for it may well happen that Tioo is reduced to 
{0}. If T is irreducible then either it is admissible or Hoc = {0}. 

Any spherical representation (T, £) is admissible. Indeed, the spherical vector £ 
belongs to the subspace Hoc- Therefore, all vectors T(g)£, where g £ G, are also in 
Hoc- Since these vectors generate a dense algebraic subspace, Hoc is dense in H, 
so that T is admissible. 

As shown in [013], admissible representations are exactly those unitary repre- 
sentations that can be continuously extended to the topological group G D G. 
Thus, admissible representations of (G, K) arc in essence the same as continuous 
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unitary representations of the group G. However, for technical reasons, admissible 
representations are more convenient to deal with than representations of G. 

Any admissible representation is a type I representation, i.e., the von Neumann 
algebra generated by it is of type I ([013, Theorem 4.1]). This means that inside 
the class of admissible representation there is no pathologies occurring for general 
representations of non-tame groups. Irreducible admissible representations admit 
a complete classification (Okounkov [Okl], [Ok2]), their explicit realization is de- 
scribed in [013, §5]. 
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